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ABSTRACT 


Repeatable  accuracy  of  hydrographic  positioning  was 
examined  in  terms  of  the  two-dimensional  normal  distribution 
function  which  results  in  an  elliptical  error  figure.  The 
error  ellipse  was  discussed,  and  two  methods  for  conversion 
of  elliptical  errors  to  circular  errors  were  given.  These 
methods  are  "circle  of  equivalent  probability"  and  "root 
mean  square  error"  (drms)-  Using  the  drms  error  concept, 
repeatable  accuracy  of  ranging,  azimuthal,  and  hyperbolic 
systems  was  evaluated,  and  methods  were  developed  to  draw 
repeatability  contours  for  those  systems. 

A  brief  theoretical  background  was  provided  to  explain 
the  method  of  least  squares  and  discuss  its  application  to 
hydrographic  survey  positioning.  For  ranging,  hyperbolic, 
azimuthal,  sextant  angle,  and  Global  Positioning  System  the 
least  squares  observation  equations  were  developed.  Specific 
examples  were  constructed  to  demonstrate  the  capabilities 
of  this  data  adjustment  technique  when  applied  to  redundant 
position  observations. 


4 


TABLE  OF  CONTENTS 


I.  INTRODUCTION . 10 

II.  REPEATABLE  ACCURACY  OF  HYDROGRAPHIC 

SURVEY  POSITIONS . 12 

A.  TYPES  OF  ERRORS . 12 

1.  Blunders . 12 

2.  Systematic  Errors  .  12 

3.  Random  Errors . 13 

B.  ACCURACY  AND  HYDROGRAPHIC  POSITIONS  .  14 

C.  REPEATABLE  ACCURACY  .  16 

1.  Elliptical  Errors  .  16 

2.  Circular  Error  Approximations  .  23 

a.  Circle  of  Equivalent  Probability-  -  -  23 

b.  Root-Mean-Square  Error . 31 

D.  REPEATABLE  ACCURACY  OF  HYDROGRAPHIC 

POSITIONING  SYSTEMS  -  - . 37 

1.  Ranging  Systems . 37 

2.  Hyperbolic  Systems-  -  -  - . 38 

3.  Azimuthal  Systems . - . 40 

4.  Sextant  Angle  Positions  .  43 

E.  REPEATABILITY  CONTOURS . 43 

1.  Ranging  Systems . 43 

2.  Azimuthal  Systems . -  -  -  -  -  47 

3.  Hyperbolic  Systems . 51 

III.  APPLICATION  OF  LEAST  SQUARES  TO  HYDROGRAPHIC 

SURVEY  POSITIONS . 59 


5 


A.  THE  PRINCIPLE  OF  LEAST  SQUARES . 59 

1.  Weighted  Observations  ----------  60 

2.  Method  of  Least  Squares  Adjustment-  -  -  -  62 

3.  Higher  Order  Functions-  -  .  76 

4.  Equations  for  the  Precision 

of  Adjusted  Quantities-  -  -  - . 79 

B.  APPLICATION  OF  LEAST  SQUARES  TO 

HYDROGRAPHIC  POSITIONING  SYSTEM  .  85 

1.  Azimuth  Angle  Positions  ---------85 

2.  Sextant  Angle  Positions  .  92 

3.  Range-Range  Positions  -----  . ioi 

4.  Hyperbolic  Positioning  Systems-  . 109 

5.  Global  Positioning  System  . 113 

C.  USE  OF  THE  ERROR  ELLIPSE  IN  ANALYZING 

THE  ACCURACY  OF  HYDROGRAPHIC  POSITIONS-  -  -  -121 

IV.  CONCLUSION . 129 

APPENDIX  A  -  ANALYSIS  OF  RANDOM  ERRORS . 132 

APPENDIX  B  -  USEFUL  GRAPHS  FOR  THE  DETERMINATION  OF 

REPEATABILITY  CONTOURS  . 140 

LIST  OF  REFERENCES . 142 

INITIAL  DISTRIBUTION  LIST . 144 


6 


LIST  OF  TABLES 


Table  Page 

1 1  - 1  Values  of  constant  h-  -  - . -  21 

1 1  -  2  Circular  error  probabilities . 25 


II -3 

II  -4 

II  -  5 

II-6 

I I  -  7 

II - 8 

III- l 

III-2 

I I I  -  3 

III-4 

A1 


Factors  for  conversion,  K,  of  the  error 
ellipse  to  circle  of  equivalent 
probability  ------  .  ------ 

Significant  parameters  of  error  ellipses 
when  cr^  *  a^-  -  --  --  --  -- . 

For  90%  probability  interval,  significant 
parameters  of  error  ellipse  when  o^  *  o 2*  -  - 

Variations  in  probability  as  a  function  of 
eccentricity-  .  ---------- 

Relations  between  28  and  01  or  0^  . 

The  angle  28  and  denning  the 

4m  d  „  contour  for  several  values  of  p  -  •  - 
rms 

For  least  squares  solution,  successive 
iterations  applied  to  azimuth  angle 
positions  ------------  .  - 

For  least  squares  solution,  successive 
iterations  applied  to  sextant  angle 
positions  ------------------ 

For  least  squares  solution,  successive 
iterations  applied  to  range-range 
positions  ------------------ 

For  least  squares  solution,  successive 
iterations  applied  to  GPS  fixes  . 

Linear  error  conversion  factors  for 
several  probability  levels . 


28 

29 

30 

35 

55 

58 

93 

100 

108 

120 

135 


LIST  OF  FIGURES 


Figure  Page 

II-l  Position  location  at  the  intersection 

of  two  lines  of  position-  ----------  17 

1 1 - 2  Expanded  view  of  the  intersection  of 

two  lines  of  position  and  associated 
error  ellipse  ----------------  18 

II-3  Contours  of  equal  probability  areas  -----  22 

II-4  Geometric  dilution  of  precision  for 

CEP  and  90%  probability  interval . 32 

I I - S  Illustration  of  root  mean  square  error-  -  -  -  33 

II-6  Variation  in  drms  with  ellipticity  (1  drms)  -  35 

II-7  A  hyperbolic  triad . 39 

II-8  Azimuthal  system  repeatability . 41 

II -9  Ranging  system  geometry  .  45 


II -10  For  ranging  systems,  the  graph 

of  the  drms/a^  and  e/b . 46 

11-11  Repeatability  contours  of  a  ranging  pair-  -  -  48 

11-12  For  azimuthal  systems,  the  graph  of 

the  drms/a-b  and  e/b . 50 

11-13  Repeatability  contours  of  an  azimuthal 

system-  -------------------  52 

11-14  In  hyperbolic  systems,  for  several 

choices  of  p,  drms/aw  curves . 54 

11-15  Repeatability  contours  of  a  hyperbolic 
system  (a  ■  .01  lane  width  and 


f  •  2  Mhz) . 57 

III-l  Azimuth  angle  positions  .  87 


8 


Ill  -2 


III  -3 
III -4 

III -5 

III  -6 


III -7 

III-8 

A1 

A2 

A3 

B1 

B2 


Determination  of  a  position  for 

azimuthal  systems  using  the  least 

squares  method-  -  --  -- . -  -  -  -  -  89 

Sextant  angle  positions . -  -  -  -  94 

Determination  of  a  position  for 
sextant  angle  fixes  using  least 
square  adjustment  --------------  97 

Determination  of  a  position  for  range- 

range  systems  using  least  square 

adjustment-  -----------------  106 

Determination  of  a  position  for  hyperbolic 
systems  using  the  least  square  adjustment 
method-  -  --  --  --1----------  -  no 

Error  ellipses  formed  at  the  determined 
positions  -----  .  -----  122 

Error  ellipse  -  -- . ----  -  123 

One  dimensional  normal  distribution  curve  -  -  134 

Equal  probability  density  ellipses . 137 

Constant  probability  density  ellipse 

for  correlated  errors  - . 139 


For  ranging  systems,  the  graph  of  the 

drms/as  and  e/b . 140 


For  azimuthal  systems,  the  graph  of. the 
drms/a-b  and  e/b . 141 


9 


I.  INTRODUCTION 


Positioning  of  the  survey  vessel  is  equal  in  importance 
with  depth  determination  in  the  collection  of  hydrographic 
survey  data.  Fundamental  to  an  understanding  of  the  accuracy 
of  position  information  is  an  analysis  of  the  various  errors 
and  their  sources  which  must  be  either  eliminated,  compen¬ 
sated  for,  or  otherwise  modeled.  The  result  of  this  analysis 
is  that  the  reliability  of  position  data  can  be  evaluated 
and  used  to  estimate  the  overall  accuracy  of  hydrographic 
soundings . 

Once  these  potential  error  sources  are  understood, 
methods  must  be  developed  to  quantify  accuracy.  Much 
research  has  been  conducted  in  this  area  in  the  past.  One 
purpose  of  this  thesis  is  to  collect  and  present  useful 
concepts  of  error  theory  which  apply  directly  to  hydrographic 
survey.  Simple  graphical  techniques  were  developed  which 
can  be  used  to  produce  accuracy  contours  as  a  function  of 
the  survey  net  geometry. 

Conventional  survey  techniques  rely  on  only  two  lines 
of  position  (LOP)  to  determine  a  positioning  fix.  This 
introduces  the  possibility  of  significant  error. 

In  navigation,  although  inherently  less  accurate  than 
positioning  due  to  the  techniques  and  systems  used  to 
determine  the  LOP’s,  three  LOP's  are  required  to  produce  a 


fix.  Position  is  adjusted  graphically  by  placing  the  fix 
in  the  center  of  the  triangle  formed  by  the  three  inter¬ 
secting  LOP’s.  This  concept  of  taking  one  redundant 
observation  can  lead  to  significant  improvement  in  hydro- 
graphic  survey  positioning  data.  Mathematical  adjustment 
techniques  such  as  the  method  of  least  squares  may  be  used 
to  determine  the  best  estimate  of  position. 

Least  square  adjustments  are  commonly  performed  on  land 
survey  data  where  redundant  observations  are  easily  made. 
With  the  advent  of  new  positioning  systems  and  computer 
technology,  making  redundant  observations  at  sea  is  no 
longer  impractical.  The  second  purpose  of  this  thesis 
is  to  explain  the  basic  method  of  least  squares,  and  to 
formulate  examples  of  the  least  squares  adjustment  pro¬ 
cedure  applied  to  specific  types  of  hydrographic  survey 
systems.  This  data  adjustment  technique  not  only  provides 
the  best  estimate  of  position  but  also  may  be  used  to  deter 
mine  the  absolute  positioning  accuracy  associated  with  each 
data  point  in  a  hydrographic  survey. 
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II.  REPEATABLE  ACCURACY  OF  HYDROGRAPHIC 
SURVEY  POSITIONS 


A.  TYPES  OF  ERRORS 

It  is  impossible  to  make  measurements  of  physical  data 
without  making  errors.  These  measurement  errors  may  be 
classified  in  the  following  manner. 

1 .  Blunders 

These  are  mistakes  which  result  from  misreading 
instruments,  transposing  figures,  faulty  computations,  etc. 

They  may  be  large  and  easily  observed,  or  smaller  and  less 
detectable,  or  very  small  and  indistinguishable  in  the 
data.  Blunders  are  usually  detected  through  comparing  repeated 
measurements,  careful  editing,  and  procedural  checks  in  the 
data  collection  process.  Physical  measurements  will  contain 
a  constant  bias  if  these  errors  are  not  removed  from  the  data 
set. 

2 .  Systematic  Errors 

Uncalibrated  instruments  or  environmental  factors, 
such  as  temperature  and  humidity  changes  which  affect  the 
performance  of  the  measuring  instruments,  will  induce  system¬ 
atic  errors  into  the  observations.  The  occurrence  of  this 
type  of  error  may  result  in  a  pattern  which  can  be  recognized 
and  mathematically  modeled.  The  simplest  pattern  to  model 
would  be  some  observable  trend  in  the  data  of  constant 
magnitude  and  direction.  Such  a  trend  can  easily  be 
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subtracted  from  the  observations  to  remove  the  systematic 
error. 

If  numerous  systematic  errors  exist,  or  the  errors 
are  such  that  they  cannot  be  accurately  modeled,  then  their 
effect  on  the  data  must  be  estimated  by  calibration.  Cali¬ 
bration  is  the  process  of  comparing  the  measuring  instrument 
against  a  known  standard.  The  difference  between  the  observed 
and  known  value  may  be  used  as  an  estimate  of  the  total  effect 
of  all  systematic  errors  present.  Thus,  calibration  provides 
a  "corrector"  which  must  be  applied  to  the  data  set.  Examples 
of  important  systematic  errors  in  hydrographic  survey  position¬ 
ing  include  instrument  errors,  errors  in  positioning  control 
points,  and  variations  in  the  propagation  velocity  of  electro¬ 
magnetic  energy. 

3.  Random  Errors 

These  errors  result  from  accidental  and  unknown 
causes.  Their  effect  cannot  be  removed  from  the  observations 
and,  therefore,  must  be  quantified  statistically.  Random 
errors  have  certain  characteristics  which  facilitate  such  an 
approach.  Positive  and  negative  errors  occur  with  equal 
frequency,  small  errors  are  more  probable  than  large  errors, 
and  extremely  large  errors  rarely  occur. 

The  frequency  distribution  of  random  errors  can  be 
modeled  mathematically  by  the  normal  distribution  function. 
Assuming  all  measurement  errors  are  independent  and  random. 
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thereby  conforming  to  the  normal  distribution,  measurement 
accuracy  can  be  specified  statistically  by  defining  a  con¬ 
fidence  interval  around  the  best  estimate  of  the  measured 
value.  Procedures  for  computing  these  intervals  are  reviewed 
in  Appendix  A. 

B.  ACCURACY  OF  HYDROGRAPHIC  POSITIONS 

The  achievable  accuracy  of  a  hydrographic  survey 
positioning  system  is  best  described  by  defining  the  follow¬ 
ing  terms:  repeatability  and  predictability. 

Repeatability  is  a  measure  of  the  accuracy  with  which 
the  positioning  system  permits  the  user  to  return  to  a 
specific  point  on  the  surface  of  the  earth  defined  in  terms 
of  the  lines  of  position  generated  by  the  system.  Included 
in  repeatability  are  the  effects  of  random  errors,  errors 
due  to  net  geometry,  and  errors  resulting  from  the  angle 
of  intersection  for  the  two  lines  of  position  that  establish 
a  fix.  Repeatable  accuracy  is  therefore  a  measure  of  the 
relative  accuracy  of  a  positioning  system.  Unresolved  biases 
exist  in  hydrographic  positions  due  to  the  presence  of 
systematic  errors  that  have  not  been  subtracted  from  the 
data  or  compensated  for  as  a  result  of  calibration. 

Predictability  is  the  measure  of  accuracy  with  which  the 
system  can  define  the  location  of  the  same  point  in  terms 
of  geographic  (or  geodetic)  coordinates  rather  than  simply 
the  intersection  of  two  lines  of  position.  Thus,  predictable 


accuracy  is  an  absolute  accuracy.  Using  conventional  hydro - 
graphic  survey  techniques,  predictability  could  be  achieved 
only  if  all  systematic  errors  were  removed  from  the  data  so 
that  only  the  effects  of  random  errors,  net  geometry,  and 
intersection  angle  remain.  For  example,  the  lattice  generated 
by  an  electronic  positioning  system  is  distorted  primarily  as 
a  result  of  the  variability  in  the  propagation  velocity  of 
electromagnetic  energy.  Ideally,  if  there  was  no  distortion, 
of  the  electronic  lattice,  then  the  accuracy  of  a  position, 
corrected  for  any  remaining  systematic  errors,  could  be 
quantified  statistically  in  terms  of  predictable  accuracy. 
However,  since  these  distortions  exist,  the  effective  velocity 
of  propagation  would  have  to  be  accurately  modeled  through¬ 
out  the  survey  area.  Then  it  would  be  possible  to  subtract 
the  effects  of  this  systematic  error  and  derive  positions 
in  terms  of  predictable  geographic  coordinates.  Research 
is  currently  being  conducted  to  quantify  the  parameters  which 
affect  propagation  velocity  in  order  to  model  these  values 
for  such  application  [Ref.  19]. 

A  second  method  to  achieve  predictable  accuracy  is  by 
making  redundant  observations  to  establish  hydrographic 
survey  positions.  If  three  intersecting  lines  of  position 
are  available  instead  of  the  usual  two,  the  resulting  fix 
is  overdetermined,  and  data  adjustment  techniques  must  be 
applied.  The  method  of  least  squares  is  most  useful  in 


adjusting  such  data.  Through  the  application  of  least 
squares  adjustment  techniques,  the  best  estimate  of  position 
is  found  and  the  position's  predictable  accuracy  is  resolved. 

A  complete  discussion  of  this  procedure  is  presented  in 
Section  III. 

C.  REPEATABLE  ACCURACY 

In  the  determination  of  hydrographic  positions,  blunders 
are  eliminated  by  observing  strict  survey  procedures,  and 
system  calibration  is  performed  in  an  attempt  to  remove  system¬ 
atic  errors.  Because  some  systematic  errors  still  remain, 
the  accuracy  of  hydrographic  positions  must  be  stated  in 
terms  of  repeatability. 

The  modeling  of  random  errors  is  done  by  using  the  two- 
dimensional  normal  distribution  function.  When  the  normal 
distribution  is  applied  to  the  positional  errors,  the  result¬ 
ing  error  figure  is  an  ellipse. 

1.  Elliptical  Errors 

Hydrographic  positions  are  determined  by  the  inter¬ 
section  of  two  lines  of  position  CLOP).  Because  of  the  errors 
in  each  LOP,  the  actual  position  may  lie  somewhere  between 
the  error  limits  (shown  as  additional  arcs  either  side  of 
LOP's  in  Figure  II -1). 

The  intersection  of  the  two  LOP's,  together  with  the 
standard  errors  associated  with  each,  is  drawn  to  an  expanded 
scale  in  Figure  II- 2.  By  applying  the  two-dimensional  normal 
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distribution  to  positional  errors,  it  is  seen  that  the  contours 
of  equal  probability  density  about  such  an  intersection  are 
ellipses  with  their  center  at  the  intersection  point. 

For  simplicity  in  the  discussion,  the  following  assump¬ 
tions  are  made: 

1.  Only  errors  contributing  to  repeatable  accuracy  are 
considered. 

2.  The  random  errors  associated  with  each  LOP  are 
assumed  to  be  normally  distributed. 

3.  The  random  errors  in  each  LOP  are  assumed  to  be 
independent,  i.e.,  a  change  in  the  error  of  one 
LOP  has  no  effect  upon  the  other. 

4.  The  LOP's  are  assumed  to  be  straight  lines  in  the 
small  area  in  the  immediate  vicinity  of  their 
intersection. 

5.  Errors  of  position  are  limited  to  the  two- 
dimensional  case. 

As  shown  in  Figure  1 1 - 2 ,  the  general  case  of  the  inter¬ 
section  of  two  LOP's  at  any  angle  and  with  different  values 
of  errors  associated  with  each  LOP  results  in  an  elliptical 
error  figure. 

It  is  readily  seen  from  Figure  II -2  that  the  exact  shape 
of  the  error  ellipse  varies  with  the  magnitudes  of  both  of 
the  one -dimensional  LOP  errors,  and  o as  well  as  with 
the  angle  of  intersection,  6. 

The  values  of  the  semi -major  and  semi -minor  axes  of  the 
error  ellipse  (using  one  a  error)  are  given  by  the  following 
equations  [Refs.  4  and  5]. 
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Semi -major  axis: 


fC*  H  l/(sV^(4Srnap)  ’  1  ; 
lSCn1^  J 


(Il-la) 


Semi-minor  axis: 


^sJL.  +  1 

2-Sin  ^  L  ■* 


(Il-lb) 


Generally  ai  “  a2  *  cr,  then  equations  (II- la)  and  (II- lb ) 
simplify  to 


tfzSin(e/2) 


MlCo s(P/2.)  . 


After  computing  the  semi-major  and  semi-minor  axes,  the 
probability  of  the  error  ellipse  is  given  by  the  distribution 
function 


P  (*  ,i))  -  1  —  e.  2  , 


where 


h2=  + 

el  ffy 

(x  and  y  are  the  errors  in  the  direction  of  a  and  o  ). 


it 


The  solution  of  equation  II-3  with  values  of  h  for  different 


probabilities  yields  the  results  shown  in  Table  II-l. 


Probability  (%) 

h 

39.35 

1.0000 

50.00 

1.1774 

63.21 

1.4142 

90.00 

2.1460 

99.00 

3.0349 

99.78 

3.5000 

Table  II- 1:  Values  of  constant  h. 


For  example,  for  39.35%  probability  the  axes  of  the 

ellipse  are  1.00  a  and  1.00  a  ;  for  50%  probability  the  axes 

x  y 

are  1.1774  o  and  1.1774  o  .  Figure  II-3  shows  the  error 
A  X 

ellipses  for  different  values  of  h. 

The  angle,  8,  between  the  semi-major  axis  of  the  error 
ellipse  and  the  line  of  position  which  has  smaller  standard 
error  is  given  by  [Ref.  5] 

4-on  1  9  = 

ff,aCos2  P  ' 
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1 1 - 3 :  Contours  of  equal  probability  areas. 


where  cr^  is  the  smaller  standard  error.  In  the  case  of 
al  *  a2*  ecluat*on  simplifies  to 

8  -JL  .  (ii-s) 

2 

The  importance  of  the  angle  0  is  that  it  specifies  the 
orientation  of  the  error  ellipse  according  to  the  lines  of 
position. 

2 .  Circular  Error  Approximations 

In  general,  the  use  of  the  error  ellipse  is  compli¬ 
cated  by  the  problem  of  axis  orientation  and  the  propagation 
of  elliptical  errors.  Therefore,  in  order  to  simplify 
probability  calculations  and  avoid  the  above  problems,  the 
elliptical  errors  are  approximated  by  circular  errors  which 
are  easier  to  use  and  understand.  The  accuracy  of  a  hydro- 
graphic  position  may  then  be  stated  in  terms  of  a  circle  of 
specified  radius  about  the  point. 

Note  that  when  the  angle  of  intersection  is  a  right 
angle  and  the  two  errors  are  equal,  the  error  ellipse  becomes 
a  circle  and  is  described  by  the  circular  normal  distribution. 
Generally,  this  is  not  the  case,  and  elliptical  errors  must 
be  converted  to  circular  errors.  This  is  done  by  using  either 
the  circle  of  equivalent  probability  or  the  root -mean -square 
error  concept. 

a.  Circle  of  Equivalent  Probability 

A  circle  of  equivalent  probability  is  obtained 
utilizing  an  existing  table  for  the  two-dimensional  normal 


distribution  (Table  II-2).  This  table  is  used  with  the 
two  standard  errors  along  the  semi-major  and  semi-minor  axes 
of  the  error  ellipse  (Equations  Il-la,  Il-lb  or  1 1  -  2 ) .  To 
find  the  radius  of  equivalent  probability,  equations  II -la, 

Il-lb  or  1 1 - 2  must  first  be  utilized  to  obtain  the  values  of 
O'  and  o  .  To  enter  the  table  the  following  ratios  are  needed: 

X  / 

c  *  where  a  is  the  greater  standard  error 

ax  x 

and 

y  m  Radius  of  circle  of  equivalent  probability 

Greater  standard  error  » 

where  K  is  the  conversion  factor  needed  to  solve  for  the 
radius  (R)  of  the  circle  of  equivalent  probability. 

The  table  relates  varying  values  of  ellipticity 
to  the  radius  of  circles  of  equivalent  probability.  Enter 
the  table  with  the  computed  values  for  c  and  k  to  determine 
the  probability  for  a  circle  of  given  radius,  or  alternately, 
for  a  given  value  of  probability,  determine  the  radius  of  the 
error  circle. 

EXAMPLE  1 1 - 1 :  The  two  standard  errors  of  a  positioning 

system  estimated  from  field  observations  are  *  6  meters. 

To  determine  the  probability  of  location  within  a  circle  of 

10  m  radius  when  the  angle  of  intersection,  0,  is  60°, 

equation  II -2  must  be  used  to  find  a  and  a  • 

x  y 
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Table  II- 2:  Circular  error  probabilities 
CBowditch,  1977). 
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er*  = 


'fT  Sin  P/2.  'JT  S(o  6°/^ 


il _ _  —  S.'tBm 


0-u=  °- 


^iCoSp/n  ^COS^.0 

X 


Jz _  —  U  .9  m  . 


Using  the  ratio,  C  =.  —  _ft l£-  ==• 

CV  8*^6 


.  58 


and 


K.  —  radios  orf  C-ioc-Le.  _  10  ^  J. .  2.  , 

^  8-48 


enter  Table  1 1 - 2  with  K  *  1.2  and  c  *  .58  *  .6.  The  proba¬ 
bility  is  found  to  be  approximately  671.  (The  value  in  the 
table  is  .6714269.) 

EXAMPLE  1 1 - 2 :  For  the  system  described  in  example  II- 1, 
the  radius  of  the  error  circle  with  90%  probability  may  be 
determined. 

First,  entering  Table  1 1 - 2  with  c  *  .6,  for  90% 

probability  (the  closest  table  value  is  .9019110),  K  is 

found  to  be  1.8.  The  radius  of  the  error  circle  is  equal 

to  K  times  o  : 

x 

1.8  x  8.48  a  15.3  meters. 
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Table  1 1 - 3  is  more  convenient  for  solving 


problems  such  as  in  example  II- 2  because  the  table  is  entered 
by  using  values  of  c  and  probability,  P,  in  order  to  solve 
for  the  conversion  factor,  K.  Note  that  the  error  circles 
identifying  the  50%  probability  area  (circular  error 
probable,  or  CEP)  and  90%  area  (circular  map  accuracy 
standard,  or  CMAS)  are  the  most  frequently  used  probability 
intervals. 

For  constant  values  of  and  a2,  circular  error 
probabilities  vary  as  a  function  of  the  angle  of  intersection, 
g,  of  the  lines  of  position.  To  simplify  the  investigation  of 
geometrical  effects,  the  common  case  of  ^  *  °  will  be 

considered.  Under  this  condition,  the  equations  for  a  and  a 

X  / 

simplify  to  equation  II- 2.  Taking  the  ratio  of  these  two 
values,  c  is  found  to  be  =  "Van(£V^  .  Using 

the  simplified  equations,  significant  parameters  of  the  error 
ellipse  have  been  listed  in  Table  II-4  as  a  function  of  the 
intersection  angle,  8,  for  the  50%  probability  interval  (CEP) 
and  in  Table  1 1 - 5 ,  for  the  90%  probability  interval.  The 
data  shows  that  the  radius  of  the  error  circle,  R,  increases  as 
the  angle  of  intersection  decreases.  In  the  last  columns, 
the  error  factor  is  defined  as 

- -  -  R  (at  any  intersection  angle) 

Error  factor  R  (at g *  90u) 
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_ _ _  Ii  irYYtrf  _ 


Factor 


Table  XI -4:  For  CEP,  significant  parameters  of  error  ellipses  when 
(Bowditch,  1977). 


or  a  multiplier  by  which  the  error  circle  radius,  R,  at  any 
intersection  angle  may  be  computed  from  the  radius  of  the  error 
circle  at  0  ■  90°.  For  example,  from  Table  II -4  it  is  seen 
that  at  a  50°  intersection  angle,  R  is  1.206  times  greater 
than  the  radius  at  6  «  90° . 

As  seen  in  Tables  II -4  and  II -5,  the  optimum 
accuracy  is  obtained  when  the  intersection  angle,  0,  is  90°. 

It  can  be  said  that  the  geometric  dilution  of  precision  (GDOP) 
is  minimum  for  a  90°  intersection  angle.  Thus,  the  error 
factor  defined  in  Tables  I I -4  and  II -S  is  commonly  known 
as  GDOP.  Effects  of  geometric  dilution  are  shown  in  Figure 
II-4  for  CEP  and  90%  probability  interval  (CMAS) .  Acceptable 
intersection  angles  for  LOP's  used  in  fixing  hydrographic 
positions  usually  range  between  the  limits  of  30°  and  150°. 

As  seen  in  Figure  I I -4,  the  radius  of  the  90°  probability 
interval  circle  is  increased  by  a  factor  of  two  near  the 
acceptable  limits  for  hydrographic  fix  angles.  Correspond¬ 
ingly,  positioning  accuracy  is  decreased  by  a  factor  of  two. 

b.  Root -Mean  Square  Error  (d«„„) 

'  rms 

The  root -mean -square  error,  d  „  ,  is  defined  as 

rms 

the  square  root  of  the  sum  of  the  squares  of  the  error 
components  along  the  major  and  minor  axes  of  the  error  ellipse. 
To  calculate  the  drms  error,  first  equations  II -la,  lb  or 
II -2  are  utilized  to  obtain  the  values  of  cr  and  o  .  Then 

X  / 

the  definition  of  d„«,  is  used, 

rms  ’ 
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Figure  I I -4:  Geometric  dilution 

of  precision  for  CEP  and  901  probability 
interval  (Bowditch,  1977). 


drrns  a  a  ,  (II‘ 

where  a  ■  ox  is  the  semi -major  axis  of  the  error  ellipse 
and  b  »  Oy.  is  the  semi -minor  axis. 

Alternately,  formulas  II -la  and  II -lb  are  sub¬ 
stituted  into  the  definition  of  drms  error  (equation  II -6) 

and  a  more  useful  form  of  d^„  is  obtained  in  terms  of 

rms 

a, ,  a 2  and  the  angle  of  intersection,  3: 

aPms  =  ^  .  (n 

S»n(£ 


Figure  II-5  illustrates  the  definition  of  d  error. 


Figure  I I - S :  Illustration  of  root  mean  square  error. 

One  d___  is  defined  as  the  radius  of  the  error  circle 
rms 

obtained  using  one  a  and  one  o  as  the  semi-major  and  semi- 

X  J 

minor  axes  of  the  error  ellipse.  Two  dms  is  defined  as  the 

radius  of  the  error  circle  obtained  using  two  times  the 

o  and  a  values. 

*  / 

The  value  of  d^j  does  not  correspond  to  a  fixed 
probability  interval  for  given  values  of  and  02*  It 
corresponds  to  a  fixed  probability  interval  only  when 

■  90°  and  a ^  »  O2  so  that  the  resulting  probability  figure 
is  a  circle.  In  the  elliptical  cases,  the  probability 
associated  with  a  fixed  value  of  d_,_  varies  as  a  function  of 

TmS 
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the  eccentricity  of  the  error  ellipse.  This  can  easily  be 
seen  with  an  example  using  Table  1 1 - 2 . 

First,  consider  ax  =  15  m,  =  10  m, 

drms  =  'J lisV1*  (lo>a'  =  18m  , 

c=3-=.fet8  and  K.  =  errcr  e:rete  ,-iS-=l.a  . 

©V.  C*. 

For  c  ■  .666  table  values  must  be  interpolated.  Enter 
Table  II -2  with  c  =  .6  and  c  *  .7  for  K  -  1.2.  The  correspond¬ 
ing  table  values  are  found  to  be  .6714269  and  .6306168. 

Thus  the  probability  of  18  m  drms  is  found  to  be  64.78%. 

Secondly,  consider  o  a  17  m,  o  =  6  m 

x  y 

<»r*.s  =,  UF  =  18  m  , 

c=  V|>  =.  353  and  _  J_.059  . 

IT 

The  interpolated  probability  from  Table  1 1  - 2  is  67.4%. 

As  seen  above  for  the  two  cases,  d _ _  errors  are  equal  but 

c  values  (eccentricity)  are  different.  As  a  result  the 
corresponding  probabilities  are  64.78%  and  67.4%. 

•  Table  II-6  shows  the  variations  in  probability 
associated  with  the  values  of  1  drms  and  2  drms  as  a 
function  of  eccentricity  (a  /a  ) ,  and  Figure  I I - 6  shows  the 

7  ^ 

same  information  graphically  for  1  drms  error. 
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Probability 


** 

1  a«,c 

rms 

2 

rms 

0 

.683 

.954 

.1 

.682 

.955 

.2 

.682 

.957 

.3 

.676 

.961 

.4 

.671 

.966 

.5 

.662 

.969 

.6 

.650 

.973 

.7 

.641 

.977 

.8 

.635 

.980 

.9 

.632 

.981 

1.0 

.632 

.982 

Table  II-6:  Variations  in  probability  as  a  function  of 
eccentricity  (Bowditch,  1977). 


**/e» 

Figure  II-6:  Variation  in  drns  with  ellipticity  (1  d^g) 
CBowditch,  1977). 
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As  seen  in  Table  II -6,  the  probability  that  the 


position  will  be  within  the  1  drms  error  circle  ranges  from 

68.31  when  o„  =  0.0  to  63.2%  when  a  *  <J  and  two  d„„,e 
y  y  x  rms 

ranges  from  95.4%  to  98.2%,  respectively. 

In  Equation  II -7,  the  drms  error  was  given 
assuming  the  errors  in  each  line  of  position  are  independent. 
If  the  measurement  of  line  of  position  #1  is  related  to 
measurement  of  line  of  position  #2,  then  there  is  correla¬ 
tion  between  o1  and  a^;  e.g.,  is  dependent  on  °2*or  a 
change  in  produces  a  corresponding  change  in  a 2.  In 
this  case,  the  equation  for  the  root  mean  square  position 
error  is  given  as 


^rms  =  -i- 

Stn£ 


'cr,x+  0-1  +■  2^0\CTaCoSp> 


(H-8) 


where  £  is  the  correlation  coefficient  between  and  a^. 

Two  different  derivations  of  this  equation  are  presented  in 
the  following  papers:  Bigelow  (1963)  and  Heinzen  (1977) 
[Refs.  2  and  10]. 

In  summary,  root  mean  square  error  is  easy  to 
ohtain  mathematically,  and  it  yields  relative  values  of 
accuracy  which  are  normally  understood.  Therefore,  in  subse¬ 
quent  sections,  drms  will  be  used  to  explain  the  repeatable 
accuracies  of  hydrographic  positioning  systems. 


D.  REPEATABLE  ACCURACY  OF  HYDROGRAPHIC  POSITIONING  SYSTEMS 
1*  Ranging  Systems 

In  ranging  systems,  the  lines  of  positions  are  drawn 
as  circles  centered  about  each  control  station.  The  repeat¬ 
ability  of  this  type  of  system  is  a  function  of  the  inter¬ 
section  angle,  6,  and  the  random  errors  associated  with  each 
line  of  position. 

The  two  ranges  are  independent  of  each  other.  There¬ 
fore,  the  correlation  coefficient,  p,  is  zero,  and  d  is 

v  rms 

given  by  Equation  1 1 - 7  which  is  repeated  here  : 

drmS  ” '  .  (III-9) 

Usually,  the  standard  errors  of  the  two  shore  stations  aTe 
equal.  The  system  standard  erTor,  og,  of  a  time  measuring 
positioning  system  is  given  as 

a.  =  a_  =  a 
1  2  s 

The  system  standard  error,  og ,  of  a  phase  comparison 
positioning  system  is  computed  as  a  fraction  of  the  lane  width 
so  that  *  °2  *  aW  *  as»  where  a  is  the  standard  error  of 
range  in  fractions  of  a  lane  (i.e.,  a  -  .1  lanes)  and  w  is 
lane  width.  Then  Equation  I I -9  reduces  to 
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X 


a 


rms 


jT  crs 
Sin  p>  ’ 


(I I  - 10) 


where  ag  is  the  system  standard  error. 

As  seen  from  the  above  formula,  the  drms  is 
smallest  at  a  90°  intersection  angle  and  becomes  large  as 
6  approaches  0°  or  180°. 

2 .  Hyperbolic  Systems 

As  in  ranging  systems,  the  repeatable  accuracy  of 
hyperbolic  systems  is  a  function  of  intersection  angle  and 
random  errors.  Because  landwidth  is  not  constant  for  hyper¬ 
bolic  systems,  the  change  in  lane  width  must  also  be  quanti¬ 
fied.  As  the  user  moves  away  from  the  base  line  between  the 
master  and  a  slave  unit,  the  lane  becomes  wider  due  to  the 
divergence  of  the  hyperbolic  LOP’s  [Ref.  8].  This  divergence 
is  expressed  as  an  expansion  factor,  E  ; 


1/sin  (9 i / 2 )  , 

where  is  the  angle  between  the  radius  vectors  from  the 
position  at  p  to  the  master  and  the  respective  slave  station 
CFigure  II-7).  Then  the  standard  error  of  one  line  of 
position  at  p  is 


0*C  =.  cr  njw  E :  =  crv^— 

Sin  f  > 


(a) 
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Figure  II -7:  A  hyperbolic  triad 


where  a  is  standard  error  in  the  base  line  in  fractions  of 
a  line,  w  is  lane  width  and  E  expansion  factor. 

The  hyperbolic  LOP's  bisect  the  angle  between  the 
radius  vectors  from  p  to  master  station  and  the  respective 
slave  station.  Therefore,  the  angle  of  intersection,  0,  is 

B  =  A±! 2-  (b) 

K  2 

Substituting  equations  (a)  and  (b)  into  II-8,  d^g  becomes 


In  a  triad  Cthree-station  net)  one  range  is  common  to  both 
lines  of  position.  Therefore,  the  correlation  coefficient 
is  not  zero.  Bigelow  (1963)  [Ref.  2]  assumes  a  value  for 
the  correlation  coefficient,  £,  of  0.33  while  Swanson  (1963) 
[Ref.  14]  gets  £  »  0.4.  Since  the  determination  of  this 
value  is  based  on  observations  comprising  a  statistical 
sample,  the  most  conservative  value;  of  drms  may  be  obtained 
by  using  £  *  0.4.  ' 

3.  Azimuthal  Systems 

In  an  azimuthal  system,  whether  it  is  optical  or 
electronic,  the  lines  of  position  are  radial  vectors  eminating 
from  each  of  the  shore  stations.  The  repeatability  of  such 
systems  is  dependent  upon  the  angular  resolution  of  the 
system,  and  the  angle  of  intersection  of  the  radial  vectors. 

The  errors  of  position  depend  on: 

(1)  the  distance,  r,  along  the  radial, 

(2)  the  angular  resolution,  a,  in  degrees, 

(3)  the  angle  of  intersection,  B. 

The  angular  error  may  be  expressed  as  an  arc  distance  perpen¬ 
dicular  to  the  respective  radial  at  p  as 


<?L 


no. 


57*296  ’ 


(a) 


where  r  is  the  distance  along  the  radial ,  a  is  angul  ar  resolu¬ 
tion,  and  57.296  is  conversion  factor  from  degrees  to  radians. 


Figure  II-8:  Azimuthal  System  Repeatability 


The  two  shore  stations  are  independent;  therefore,  the  corre¬ 
lation  coefficient,  £,  is  zero. 

Substituting  Equation  (a)  into  II- 7  , 


(11-12) 


Applying  the  sine  law  to  the  triangle  shown  in  Figure  II -8, 
it  is  seen  that 


m  r*  =  )a _ 

Svo  S(nO*o*(®»tOan 
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where  Sin  [180°  -  C®  1  +  02)]*  Sin  0  “  Sin  C6i  +  e2)  and 
b  *  baseline  distance.  And  Equation  11-12  may  be  written 
as 


^cms 


S-f.196  Sina(®i+®») 


(11-13) 


Bigelow  (1963)  [Ref.  2]  approximates  Equation  11-13  by 
letting 


r»  «  rx 


_ 

S-Sinfc/a 


Then  Equation  11-13  reduces  to 


drms  .  —Slfe - - i -  (11-14) 

>fT  US>-19&  Sin  £  •  sin 

Equation  11-14  is  the  approximate  form  of  Equation  11-13. 
However,  Equation  11-14  is  easier  to  compute  and  the  error 
introduced  is  negligible.  For  a  *  .03°,  b  *  8000  meters, 

9^  *  80°,  0 2  *  30°, comparing  the  equations  11-13  and  11-14: 


using  11-13 

d  _  (-03X8000)  .  £ _ 

rrns  57- 19  fc  Sin*(fccM<5) 

using  11-14 


80°  -fr  Sin*  3>0° 


~  S.lm  , 


<Jrms  =  OoiUeoeo)  .  _ i _  -  5.  5  m  , 

\/a.  *  57. 29b  Sin  JO0  Sin  To% 


it  is  seen  that  the  difference  between  Equation  11-13  and 
Equation  11-14  is  negligible. 


4.  Sextant  Angle  Positions  (Three  Point  Fixes) 

The  evaluation  of  repeatability  for  sextant  angle 
positions  is  difficult.  The  mathematics  involved  in  the 
computation  are  quite  complex.  Thus,  repeatability  of 
sextant  angle  positions  is  more  easily  evaluated  by  a  graphi¬ 
cal  analysis.  For  the  development  of  an  analytical  solution, 
see  Heinzen  (1977)  [Ref.  10]. 

As  will  be  seen  in  later  sections,  it  is  much  easier 
to  derive  the  accuracy  of  sextant  angle  positions  by  applying 
the  method  of  least  squares. 


E.  REPEATABILITY  CONTOURS 

Using  the  root  mean  square  error  concept,  one  can  con¬ 
struct  a  family  of  curves  to  display  convenient  values  of 
drms  in  terms  of  the  system  geometry. 

1 .  Ranging  Systems 

For  ranging  systems,  the  drms  is  given  by 
Equation  II -10  as 


^rms 


'Ti  g~s 
Sin  £ 


(II -10) 


Note  that  the  intersection  angle,  3,  is  the  only 
controlling  geometric  factor  of  drms.  Figure  II -9  shows  an 
example  of  suitable  geometry  for  a  ranging  system.  Matheraati 
cally,  it  can  be  proven  that  the  intersection  angle,  $, 


is  equal  to  the  angle  formed  by  radius  vectors  from  p  to 

the  slaves  and  also  the  angles  S^D  and  S2OD.  The  locus  of 

points  having  a  constant  d _ _  and  constant  3  describes  a 

rms 

circle  of  radius  r  *  b/2  Sin  S  with  the  two  shore  stations 
as  points  on  the  circle. 

The  distance,  e,  along  the  perpendicular  bisector  of 
the  line  connecting  two  shore  stations  to  the  center  of  the 
circle  is 


e  - 


b 


0.  tan  ^ 


(H-15) 


(since,  from  Figure  II -9,  tan  3 


b/2 


),where  b  is  the  distance 


between  shore  stations  and  S2» 

Using  2  og  error  (approximately  951  probability 
interval), Equation  11-10  may  be  written  in  the  following 
form 

^rms  T.  '1 1' 


Writing  Equation  11-15  as 


e 

b 


itan  £ 

Figure  11-10  was  constructed  to  show  the  relationship  of 
drms/°s  an<*  as  a  function  of  intersection  angle,  3. 
Using  this  graph,  selected  contours  of  constant  drms  may 
be  drawn  as  in  Figure  1 1 - 11 .  First,  plot  the  location 
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of  the  two  shore  stations  at  a  convenient  scale.  Draw  a 

perpendicular  bisector  to  the  line  joining  them.  Using 

Figure  II -10  determine  the  values  of  e/b  for  the  desired 

d  contours.  From  the  known  value  of  b,  determine  distance 
rms 

e  for  each  contour.  Lay  off  distance  e  along  the  perpen¬ 
dicular  bisector  to  define  the  center,  0,  of  the  desired 
constant  d_.  circle.  The  radius  of  the  selected  contour 

i  ms 

is  the  distance  from  the  center,  point  0,  to  the  shore 
stations. 


45 


Example  II -3:  A  phase  comparison  range-range 


positioning  system  has  standard  error  •  .01  w  (lane  width) 
It  operates  at  2  Mhz  frequency.  The  distance,  b,  between  two 
shore  stations  is  20,000  m. 

Lane  width,  w  -  ^  -  ^jjj}0  -Km, 

°s  *  crw  *  75  x  .01  *  .75  m  . 

For  the  2  m  drms  contour,  drms/os  •  2/. 7 5  *  2.66. 

Enter  Figure  II -10  with  drms/as  »  2.66  which  intersect  the 
drmS/as  curve  at  85°.  Follow  the  85°  line  vertically  to 


Intersection  angle  ,  8,  in  degrees 

Figure  II -10:  For  ranging  systems,  the  graph  of  the 
drms^°s  and  e^**  (For  enlarged  figure, 
see  Appendix  B.) 


the  e/b  curve.  It  intersects  at  e/b  3  .043.  For  this 
specific  pair  where  b  3  20,000  m, 


e  3  b  (.043)  3  860  m 

Using  the  described  technique,  the  2m  drms  contour 

can  be  drawn,  and  the  result  is  shown  in  Figure  II -11. 

Thus  between  the  2m  drjns  contour  for  6  3  85c  and  the  2m  drms 

contour  for  0  3  95° ,  the  d„„,.  error  for  the  described  system 

*  rms 

will  be  <  2m.  95$  of  the  time. 

Note  that  when  the  angle  of  intersection,  0  3  90°, 

d„„  error  is  minimum.  Therefore,  as  0  increases  toward 
rms 

180°  or  decreases  toward  0°,  d,^,,.  becomes  larger.  Because 

*  rms 

the  tangent  of  the  angles  greater  than  90°  is  negative, 

e  values  will  be  negative  as  well.  Thus,  the  center  of 

the  constant  drms  circles,  for  angles  greater  than  90°, 

will  be  on  opposite  side  of  the  baseline.  As  shown  in 

Figure  II -11,  drms  error  increases  as  the  baseline  is  approached. 

Contours  for  d _ _  values  of  3,  4  and  5  meters  may  be  constructed 

by  following  the  procedures  outlined  above. 

2 .  Azimuthal  Systems 

For  azimuthal  systems,  drms  error  is  given  by 
Equation  11-14  as 


^cms 


o.  W  #  ^ 

n/T  296  S«'n  £  9vn  $/l  * 


where  a  is  the  angular  resolution,  measured  in  degrees, 
b  is  the  distance  between  two  azimuth  stations  and  3  is 
the  intersection  angle  of  radial  vectors  which  is  defined  by 
the  equation  8  3  180°  -  (0^  +  02)  (Figure  1 1  - 8 ) .  As  with 
ranging  systems,  the  intersection  angle,  8,  is  the  only 
geometric  factor  contributing  to  drms>  Constant  error  con¬ 
tours  are  obtained  in  a  similar  fashion. 

Writing  the  Equation  11-14  with  2a  error  (approximately 
951  probability  interval)  as 

dr  ms  _  1 _  i 

a*b  (5?.  296)*  Smp.Sfe  P/a.  ’ 

where  a  =  angular  resolution  and  b  *  baseline  distance. 

Since  e/b  -  1/(2  tan  8),  a  graph  is  drawn  showing  drmj./a*b 

and  e/b  as  a  function  of  intersection  angle,  8  (Figure  11-12). 

Figure  11-12  provides  a  convenient  means  to  obtain 
the  values  of  e  distance  for  a  selected  drms  if  a  and  b 
are  known. 

Example  II -4:  The  distance,  b,  between  two  azimuth 

shore  stations  is  2,000  m.  Angular  resolution  of  the  station 

is  a^  *  a2  *  .01°. 

For  the  2  meters  d^c  contour 

rms 
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to i 1  --  - 


Values  of  d 


10  20  30  40  SO  100  200 


Values  of  angle  B  (in  degrees) 

Figure  11-12:  For  azimuthal  systems,  the  graph  of  ^rfni 

°  Cl1'* 

(For  enlarged  figure,  see  Appendix  B.)  , 


50 


.1  which  intersects 


Enter  Figure  11-12  with  drms/a*b  * 

the  d  /a-b  curve  at  44°.  Follow  44°  line  vertically  to  the 
rms' 

e/b  curve,  which  intersects  at  e/b  *  .52.  For  this  pair  where 
b  *  2,000  m,  e  -  2,000  x  .52  *  1040  m.  Using  the  technique 
as  described  for  ranging  systems, the  2m  drms  error  contour 
may  be  drawn  (Figure  11-13).  Other  contours  are  computed 
in  same  manner. 

Note  that  when  B  >  90°,  the  tangent  value  is  negative 

and  the  center  of  constant  drms  circle  will  be  on  the 

opposite  side  of  the  baseline.  For  azimuthal  systems,  the 

minimum  d„m„  error  is  found  at  8  *  109°. 
rms 

3.  Hyperbolic  Systems 

The  root  mean  square  error  for  hyperbolic  systems 
is  given  by  Equation  II -11  as 


6 


rms  — 


1  1  p  Cos  ft 

Sfoa|>  S'\n  -  SCn 


(11-11) 


where  a  is  the  standard  error  along  the  baseline  between  the 
master  and  respective  slave  station  in  fractions  of  a  lane, 
w  is  the  lane  width  and  B  is  the  intersection  angle  which  is 
equal  to 

6+0 

3  »  — ^ — -  (Figure  1 1  -  7)  . 


Equation  1 1  - 1 1  is  written  with  2o  error  as 

-3=— \/Zj L-  „  a,  , 

Vsio’41  s;r?  sii.l,  gi 

a  2.  i  a 

where  the  correlation  coefficient,  was  taken  as  .4 
[Ref.  14].  Figure  11-14  was  produced  to  show  the  drms/ow 
values  as  a  function  of  the  angle  subtended  by  the  two  slave 
stations ,  i .e . ,  28  . 

A  parameter,  p,  defined  as 

p  -  -  OJL  or  p  -  ©i+ii  -  CLP 

01  ©I  ©2  02. 

The  parameter,  p,  is  computed  with  the  smaller  of  the  two 

angles,  Oj  or  a 2,  in  the  denominator.  Thus  when  p  *  2 

the  master  station  is  positioned  on  the  bisector  of  the  angle 

subtended  by  two  slave  stations,  p  *  3  places  master  station 

on  one  of  the  two  trisectors,  and  so  on  (Table  1 1 - 7) . 

Knowing  the  angle  subtended  by  the  two  slave  stations 

at  a  particular  point.  Figure  11-14  may  be  used  to  develop 

contours  of  constant  d^„0 .  First  determine  the  d  „,„/ow  ratio 

rms  rms 

for  a  selected  drms.  Enter  Figure  11-14,  for  several  values 
of  parameter  p,  and  read  the  corresponding  values  of  angle  28. 
Using  the  relation  between  23  and  0^  C 0 2 (Table  H-7),  plot 
these  angles,  28  and  0^  (92^»  on  a  conveniently  scaled  chart 
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Values  of  d 


with  a  three  arm  protractor.  Interpolating  between  the  points. 


draw  the  d _  contour.  The  curve  thus  determined  defines  the 

rms 

location  of  a  selected  d  „  contour  for  the  specific  conditions 

rms 

of  triad  configuration. 

Example  1 1 - 5 :  A  hyperbolic  system  has  standard 
error,  o,  equal  to  .01  lanes  along  the  base  line.  It 
operates  at  a  frequency  of  2  Mhz.  Triad  configuration  is 
as  seen  in  Figure  11-15  : 

lane  width,  v  *  ^  *  75  ra 

ow  »  75  m  x  .01  ■  .75m. 

For  the  4  m  drms  contour tdrms/ow  *  4/. 75  *  5.32.  Enter 
Figure  11-14  with  drms/ow  *  5.32.  For  several  values  of  p, 
read  the  corresponding  values  of  angle  2$.  Determine  the 
values  of  angles  0^^  or  according  to  Table  II -7.  For  the 
4m  contour,  these  values  are  shown  in  Table  II-8.  Using  a 
three  arm  protractor,  the  points  defining  the  4m  d^g  contour 
may  be  plotted.  The  other  contours  are  drawn  in  a  similar 
manner  (Figure  11-15). 


III.  APPLICATION  OF  LEAST  SQUARES  TO 
HYDROGRAPHIC  SURVEY  POSITIONS 


A.  THE  PRINCIPLE  OF  LEAST  SQUARES 

Given  a  set  of  unknown  parameters  to  be  computed  from 
measured  physical  quantities  such  as  distance  or  azimuth, 
the  least  squares  method  provides  a  mathematical  procedure 
by  which  the  best  values  for  the  unknown  parameters  may  be 
obtained. 

Equations  must  be  written  to  define  the  relationship 
between  the  observed  and  the  unknown  parameters.  If  the 
number  of  equations  that  can  be  written  is  equal  to  the  number 
of  unknowns,  then  a  unique  solution  may  be  computed. 

However,  no  statement  can  be  made  about  the  accuracy  of 
the  solution.  In  the  least  square  method,  the  number  of 
equations  must  be  greater  than  the  number  of  unknowns. 

As  a  result  of  this  over-determined  solution,  the  best  values 
for  the  unknown  parameters  are  estimated. 

This  computational  procedure  is  referred  to  as  a  least 
squares  adjustment.  In  application,  corrections  are  com¬ 
puted  and  applied  to  observed  quantities  and  these  quantities 
are  then  said  to  be  adjusted. 

For  a  given  set  of  equations,  the  fundamental  condition 
of  the  least  square  technique  requires  that  the  sum  of  the 
squares  of  the  residuals  be  minimized.  A  residual  is  defined 
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as  the  difference  between  an  oberved  value  of  a  quantity 
and  the  arithmetical  mean  value  of  that  quantity  obtained 
from  a  number  of  observations.  If  the  arithmetical  mean  value 
is  stated  by  x^  and  observed  value  by  x^,  the  residual,  v, 
is  expressed  as 


v  "  xi  '  xi  •  (III-l) 

Suppose  a  set  of  observations  were  taken  having  residuals 

vl’  v2’  v3 . *  vn*  Then  in  equation  form,  the  fundamental 

condition  of  least  squares  is  expressed  as 

=  NtY1  +  l>lai  +  smimmum  ,  (III-2) 

T 

or  in  matrix  form:  V  V  ■  minimum. 

1.  Weighted  Observations 

In  general,  some  of  the  observed  values  may  be  more 
precise,  and,  therefore,  entitled  to  have  greater  influence 
upon  the  result.  Observations  are  assigned  values  called 
weights  corresponding  to  their  quality  or  worth. 

The  assignment  of  weights  to  observed  values  is 
largely  a  matter  of  judgment.  For  example,  if  one  set  of 
measurements  of  a  distance  was  made  with  four  repetitions 
and  another  was  made  with  eight  repetitions,  the  mean  of  the 
second  set  of  observations  may  be  given  twice  the  weight 
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of  the  first  set.  Or,  when  measuring  angles  in  azimuth  angle 
positions,  the  atmosphere  may  be  so  unsteady  during  one  obser¬ 
vation  that  the  observer  arbitrarily  assigns  a  weight  of 
one  half. 

As  a  general  rule,  if  a  standard  error,  o,  has  been 
computed  for  a  set  of  observations,  then  weights  are  usually 
estimated  according  to  the  equation 

JiL  ,  (III-3) 

<Tl 

where  w^  is  the  weight  of  the  ith  observed  quantity,  a ^ 
is  the  standard  error  of  that  observation, and  k  is  any 
number  which  has  the  same  value  for  all  observations. 

Equation  III -3  states  that  weights  are  inversely  proportional 
to  the  square  of  the  standard  error.  Usually,  the  weight 
corresponding  to  the  least  accurate  measurement  is  assigned 
a  value  of  1  (a  unit  weight).  Then  the  value  of  k  can  be 
found  and  the  other  weights  computed  accordingly. 

For  example,  consider  the  standard  error  for  two 
observations  where  *  3,  and  a 2  *  1.5.  Assigning  w^^  *  1  , 


l  -  X 

CSV* 


j 
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it  is  found  that  the  second  observation  has  a  weight  of  4  relative 
to  the  first  observation. 

If  measured  values  are  to  be  weighted  and  used  in  a 
least  squares  adjustment,  then  the  condition  is  that  the  sum 
of  the  weight  times  their  corresponding  squared  residuals 
must  be  minimized, 

<\ 

T  + . smmimum  ,  (III-4) 

or  in  the  matrix  form,  \iT\K/V  —  minimum  . 

2.  Method  of  Least  Squares  Adjustment 

In  the  "observation  equations"  method  of  least 
squares  adjustment,  the  observed  quantities  are  related  to 
the  desired  unknown  quantities  through  formulas  or  functions 
which  are  called  observation  equations. 

One  observation  equation  is  written  for  each  measure¬ 
ment,  and  it  is  assumed  that  observations  are  independent 
of  each  other.  In  order  to  solve  for  the  best  value  of  each 
unknown  parameter,  at  least  one  redundant  observation  equation 
must  be  written.  That  is,  the  number  of  observations  must 
be  greater  than  the  unknowns. 

Observation  equations  may  be  linear  or  higher  order 
functions.  Linear  observation  equations  can  be  written  in 
general  as  follows  : 


Q|  ^  y  +  i  + . .  ■  •t'ki  ■=■ 

a2jt  +  bay  +  . . v|Ci 

•  *  1  i  J 

:  ;  ;  |  (iii-5) 

Q0i  +  ^  . *  kn  *  ®r>, 


where  a's,  b’s,  cfs,  etc.  are  coefficients  of  unknowns  x,  y, 
z,  etc.  and  the  k's  are  constants. 

Because  the  observations  (G^,  G2 . Gn)  are  not 

free  from  random  errors,  each  G.^  must  be  corrected  by  a 
residual  value,  v^  in  order  to  obtain  a  mathematically 
correct  equation  system.  Thus, 

* -v  M  ♦  c-tl  «• . =6 , 

Oa A  •+  k»ay  -t  c^i.  -t _ _ .  +k-a  —  Gi -♦•Va  (I II -6) 

■  <  .  i  * 


Qn«.  +  V>ny  "*■  cr>t  *  — . +  =•  6n+Vn  # 

Introducing  a  new  notation  *  G^  -  k^,  ^  "  ^2* 

etc.,  the  following  equation  is  obtained: 
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In  the  above  matrices,  the  subscript  n  denotes  the  number  of 
observations  and  m  denotes  the  number  of  unknowns. 


For  a  group  of  equally  weighted  observations,  recall 
that  the  following  condition  must  be  enforced  in  order  to 
perform  a  least  square  adjustment: 


a 

UO  —  minimum  , 

1*1 


or  in  the  matrix  form. 


V  V  *  minimum 


Substituting  the  value  for  the  V  matrix  from  the  observation 
Equation  1 1 1 - 8  where  V  *  AX  -  L  , 


=  tAX-L^t  AX-L> 
r  L(AX}t-lt3(A%-l> 

=  UTAT-  lt)  t  Ax-O 
=  XtAtAX  -  -  C AX  tCL 


C  (Axf  =  XTAT  3 

(■from  motri*  algebra) 


and  from  matrix  algebra,  iJAX  =  X.tATV-  > 


then 


VrV  «  XtAtAX  -  1  ata"l  +ltl  . 
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The  minimum  of  this  function  can  be  found  by  taking 
the  partial  derivatives  of  the  function  with  respect  to  each 
unknown  or  with  respect  to  the  X  matrix  (which  contains  all 
of  the  unknowns)  and  equating  it  to  aero,  i.e.: 

i(VTV>)  =  2*TA*-2A7\_  =  0. 

■a* 

Dividing  by  2,  the  following  result  is  obtained: 

AT  A*  -  ATt_  -  0.  1 3E-  9  ) 

This  is  called  the  normal  equation.  In  conventional  notation 
the  normal  equation  (III-9)  becomes 


Coal  *  +  Cably 

+  Cacli  + _ 

_ Co*]  =0 

tba  1  x  +,  [bbl  y 

+  C  b  cl  i  +  . . . . 

•  - .-CbJ?]  cO 

Tc  a  1  k  +  Cc-bly 

<  1 

1  • 

I  i 

♦  Cecil  v  . . 

♦ 

! 

. -Ceil  =0 

i 

I  ; 

[no  1  t  +  C  nbljj 

1 

i 

+  t  n  el  i  v  -  - . . 

. -Cnil  -0 

where  the  symbol  [ 

[aa]  -  aiax  +  a^ 

♦  b-a_  +  b  a_  +  . . 
2  z  e  3 


]  denotes  the  sum  of  the  products , 

+  a, a.  +  .  +  a  a  .  [ba]  a  b,a, 

33  n  n  1  11 


i.e 


> 
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In  Equation  III-9,  A  A  is  the  matrix  of  normal 
equation  coefficients  of  the  unknowns.  Multiplying  Equation 
II I -9  by  (A  A)  and  reducing,  the  solution  is  obtained. 

(At/0"AIAtM*  -  (ATAfVTL  —  0  , 


X  =  (ataWl  . 


(III-10) 


Equation  III -10  is  the  basic  least  squares  matrix  equation 
for  equally  weighted  observations.  The  matrix  X  consist  of 
best  values  for  the  unknowns  x,  y,  z,  etc. 

For  a  system  of  weighted  observations  the  funda¬ 
mental  condition  is 

£  /  \a 

2_  ^  i  l  Vi. )  =  minimum, 

L«i 

or  in  the  matrix  form  ,  VTv*/V  s  mimmum. 

The  normal  equation  matrix  is  derived  similarly  to 
the  unweighted  case. 

ATWKX  -  AT  V/  L  -s;  0  ,  (in-ii) 


or  in  conventional  notation 


C  \tfaa  1  *■ 

-v  C  wab  7  . . 

. -Lwa/l  -o 

L  s*ba  1  % 

1 

1 

+  C>*V>bl  + . 

i 

1 

. -  Lwbfl  -0 

i 

C  w  n  ol  X 

» 

i 

+  C.\*nb7  +. . 

t 

I 

. .Cv/nH  =0 

In  Equation  III-ll  the  matrices  are  identical  to  those  of 
the  equally  weighted  equation,  with  the  addition  of  the 
matrix, \*/,  which  is  a  diagonal  nxn  matrix. 

In  detail,  W  becomes 


W.  o  0 


0  0 
0  0  0 


0 

0 

0 


where  according  to  Equation  III-3, 


(III- 12) 


,  '"a  *  J—  »  ^  3  -  -~r  j  . c^c-  • 

*4  ^ 

The  best  values  of  unknowns  are  obtained  by  solving 
Equation  III-ll  as 
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Y.  =  (  ATV>/ XT*  ATWl_. 


cm -13) 


From  the  combination  of  Equations  III-8  and  1 1 1 - 9  or  III-8 
and  III-H,  it  is  seen  that 

AT(VtO  -Atl  =o  or 
AT  W  ( V  -  Atsa/  L  o  . 

Therefore, 

ATV  «  0  or  At\A/V  s  0.  (III-14) 


Equation  HI-14  can  be  used  as  a  check  on  the  computation. 

Example  I I I - 1 1 :  As  an  elementary  example  illustrating 
the  method  of  least  squares  adjustment  by  the  observation 
equation  method,  consider  the  following  equally  weighted 
observations : 

I 

+  m\o  ^ 

+3m  *5 
+  fa  —  1  *3  *  3 

-ft  -fa  -  M  =  -  6 .  : , 


lThe  numerical  values  of  this  example  problem  were  taken 
from  Ref.  17,  page  517. 
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These  four  equations  relate  the  three  unknowns  x^,  x^  and 
Xj  to  the  observations. 

By  including  residuals,  the  equations  may  be 
rewritten  as  observation  equations  as  follows : 

'l  %  i  +  3  =  \0  •+  vt 

\i  +  3*3  -ss  S  +  Va 

-  -*a  -  >3 

or  in  matrix  form, 

“ i}~~ L  •> 

where 


> 


J 
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The  normal  equation  is 


AT A  K  -  ATL 


2  1  7  -i 

13  1 

ATA  = 

3-2  1  -i 

1-2  3 

7  i  -2 

— 

i 

-» 

i 

* 

<"C 

-H 

_ 1 

-t  -1  -1 

L 

i 

N 

•4 

1 

y~ 

10 

52 

ATV-  - 

i - 

w-  ^ 

u»  jo 

^  *- 

1  1 

l —  v— 

S 

3 

-6 

— 

28 

25 

55  11  -8 

ti 

r 

ata*-atl  a. 

12  15  “4 

7a 

- 

-8  -4  15 

73 

L  j 

i 


5 

T. 

2 


And  the  solution  is  y,  =  (AT A')  AT L.  J 

.022859  -.otfcief  -0078748 

-.016187  .083233  .0135618 


(AVf1* 


007875  «  0)3  5623  .074483 


.  021859 

-  .01618? 

,  00  78>V8 

52 

.0*2233 

.  0(3  5623 

29 

.  00?8T5 

.0135623 

.  07*i*i  83 

25 

.  S\b\ 

1.9U09 

2.6fc*<88 


Thus  the  best  values  for  the  unknown  parameters  x^t  x2  and 

Xj  are  Xj^  *  .9161,  x2  *  1.91109  and  x^  *  2.66488. 

This  computation  was  performed  by  requiring  that 
T 

V  V  ■  minimum.  Thus,  when  the  best  values  are  used  in  the 
equation  V  «  AX  -  L,  the  resulting  minimized  residuals  can 
be  found.  If  the  minimized  residuals  are  applied  to  the 
observations  then  the  observations  are  said  to  be  adjusted. 


2  3  i 

.9161 

10 

. 23035 

V  »  A*-L  * 

1  -2  3 

?  1  -1 

1-91109 

- 

5 

3 

at 

*  08854 

-♦053? 

-L  -i  -l 

2  .4649 

-6 

.SOT-93 
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V  = 


„  23035 
.  08  856 
- .  0  53  7 
.  50793 


Then  adjusted  observations  are  G^  *  10.23035,  G^  *  5.08856, 
G3  *  2.9403  and  G4  -  -5.49207. 

T 

Computational  check:  A  V  must  be  equal  to  zero 
according  to  Equation  III-14  . 


2  1  ?  -A 

.  23  035 

.OOO 

ATV  , 

>  08856 

3  -2  i  .1 

— 

.OOO 

-OS9T 

— -4 
• 

o* 

1 

*■*> 

— H 

.OOO 

L  - 

- 

- 

According  to  the  theory  of  probability,  the 
above  values  of  x^,  X2  and  x^  have  the  highest  probability 
of  occurrence. 

Example  1 1 1 - 2 :  Suppose  the  constant  terms  10,  5, 
3,  and  -6  of  the  observation  equations  of  Example  I I I - 1 
represent  measurements  having  relative  weights  of  1,  2,  2, 
and  3,  respectively.  Using  weighted  least  squares,  best 
values  for  x^,  x^  and  x3  will  be  calculated. 


73 


The  observation  equations  in  Example  III-l  were 


2 

+  3)12 

+  *3  =  10  ■+  Vi 

Xt 

-  1X2 

+  3X3  =  5  + 

-2X3  =  3>  +  v* 

-  Xi 

- 

-  Xl  »  -fc  TV* 

or  in  the  matrix  form^ 


V  *  AX  -  L  , 


where 


- 

- 

- 

• 

• 

1 

3 

i 

x, 

10 

v, 

i 

-1 

3 

* 

^  L  = 

5 

j  V  * 

i 

-2 

3 

“i 

-1 

-i 

*1 

-6 

The  normal  equation  for  weighted  observations  is 

atwax  -aV/l  =0, 


where  weight  matrix  W  is  a  diagonal  matrix  of  weights  as 


follows : 


V/ 


i  0  0  0 
0  2  0  0 
0  0  2  0 
0  0  0  3 
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A  41 

• 

- 

- 

*■ 

1  1  7  -i 

i  0 

0  0 

2  3  1 

107 

19 

-17 

At\a/A» 

5-214 

0  2 

0  o 

1-2  3 

»9 

22 

-10 

0  o 

2  o 

7  1-2 

i  3-2-1 

0  0 

o  3 

-1  -1  -i 

-17 

-10 

30 

*117-1 

i 

0 

0 

0 

10 

9o 

A^VOL- 

3  -2  1  -i 

0 

2 

0 

0 

5 

_ 

34 

C 

0 

1 

0 

3 

1  3  -1  -i 

0 

o 

o 

3 

-6 

4t 

ood 


A*  -  ATWL 


•  *< 

• 

»  - 

IOT  13  -IT 

K. 

80 

19  22  -10 

fca 

- 

34 

-17  -10  30 

— 

*3 

46 

The  solution  is  )(s  (AT\VA  V*'  AT\AL  ; 


.0113838  —  -  OO  S|3I4  „  00  374 

90 

X  - 

-.00*1314  .OS91T9S  .015185 

34 

.  00  374  .015  18  54  .  0405147 

46 

.  3X01 


X  a 


1.9656 


1.7156 


\ 


or  ,  *a*  1.9856  on*  n*  a  1.7166  . 
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Residuals  are  found  using  Equation  1 1 1 - 8 : 


2  3  i 

—  — 

to 

.  51  36 

.  92  Oi 

V=K*-L  = 

i  -1  3 

L/3856 

5 

.098? 

7  i  -2 

2.?l66 

3 

-.0063 

-1  -i  -1 

-6 

.  3?7? 

Computational  check: 

ATWV 

must  be 

zero. 


^WV  = 


Tl  i  ?  -i 

3-2  1  -1 

i  3  -2  -1 


i  0  O  0 
0  2  0  0 
0  0  2  0 
o  o  0  3 


-  5136 
.098? 

—  0063 

.3  m 


.005 
.000 
.  OOO 


3.  Higher  Order  Functions 

The  observation  equations  presented  by  Equation  III -8 
are  linear  equations.  If  this  relationship  is  nonlinear, 
thus  defined  by  a  higher  order  function,  then  the  observation 
equations  must  be  linearized  in  order  to  apply  the  least 
square  adjustment  method. 

Defining  the  general  observation  equation  as 
G  *  f (x,  y) ,  where  f  represents  a  non-linear  function. 

The  function  must  be  linearized  by  Taylor  series  expansion 
or  by  some  other  method.  The  best  values  of  x  and  y  can  be 


regarded  as  the  sum  of  an  approximate  value  xQ,  yQ  and  a 
small  correction  Ax,  Ay.  Therefore  x  ■  xQ  +  Ax  and 
y  *  yQ  +  Ay  and  the  above  function  is  written  in  the  following 
form 


G  -  f(xQ  ♦  Ax,  yQ  +  Ay). 

Using  Taylor  series  expansion  the  observation  equations  may 
be  linearized. 


G 


£  (  *0  J  )jo} 


+• 


+ 


2JL  Aq  •*.  Higher  order  -Verms  . 

-3>3o 


CHI-14) 


The  higher  order  terms  in  the  series  are  neglected  and  only 
the  zero  and  first  order  terms  are  maintained. 

After  linearization,  the  observation  equations 

become 

V.  -  A.  ,  •*>(»•  .*  >  A.J  s. 

va.  5Sii2iiil63  +  f*U..,v|A-fia 

"by* 

«  J  I  I 


(III-15) 


or  in  the  matrix  form,  V  *  AX  -  L,  where 


V, 


2£l 

"byo 


Ik 


>jo 

i 

i 

i 

i 


v, 


\U 


Va. 

i 

l 

\ 


L  = 


Ga-fiUo^ 
£<v-fn  U«»^ 


\ 


The  remainder  of  the  least  square  procedure  is  the  same  as 
indicated  by  Equations  III-9,  III-10  or  III-ll,  III-13. 

In  the  linearization  process,  the  higher  order  terms 
were  neglected.  For  this  assumption  to  be  valid.  Ax  and 
Ay  should  be  small  so  that  their  products  in  the  series 
expansion  approach  zero. (Ax  •  Ay  3  0) .  This  can  be  achieved 
only  if  the  values  of  xQ  and  yQ  are  very  close  to  the  values 
of  x  and  y.  Therefore,  xQ  and  yQ  must  be  precomputed,  or 
the  original  assumed  xQ  and  yQ  must  be  improved  by  successive 
iterations  until  the  adjusted  observations  equal  the  measured 
values. 
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4.  Equations  for  the  Precision  of  Adjusted  Quantities 

After  calculating  the  best  values  of  the  unknowns, 
or  X  matrix,  the  V  matrix, or  the  adjustments  to  the  observations, 
can  be  computed  from  the  observation  equation  which  is 
V  *  AX  -  L,  whether  the  observations  are  weighted  or  not. 

Using  the  V  matrix,  the  standard  error  of  an  obser¬ 
vation  of  unit  weight  is  given  by  the  following  equations 
[Ref.  17]: 

for  unweighted  observations, 


O'  o  * 


(III-16a) 


for  weighted  observations, 


Co  - 


-t/T WCVI  _  v/vV 


n-m 


n-m 


(III-16b) 


where 

c0 is  the  standard  error  of  an  observation  which  has  unit 
weight , 


n  is  the  number  of  observations, 
m  is  the  number  of  unknowns. 


Standard  errors  of  the  best  values  for  the  unknowns  are 
then  given  by  the  following  equation: 


(III-17) 


where 

o.  is  the  standard  error  of  the  ith  adjusted  quantity, 
e.g.,  the  quantity  in  the  ith  row  of  the  X  matrix, 
oq  is  the  standard  error  of  unit  weight  as  found  by 
Equation  III-16a  or  III-16b, 

T  - 1 

q^  is  an  element  of,  for  unweighted  case,  (A  A) 

T  -1 

or,  for  weighted  case,  (A  WA)  matrix. 

If  the  (A^A) ' *  or  (ATWA)_1  matrices  are  written  in  detailed 
form  as 

"• 

Six  9*3  — 

931  Six  S^  -- 

•  I 


(ATA>"or(AT'NA)"'  J 


then  the  standard  errors  of  the  best  values  of  the  individual 
adjusted  quantities  are: 


Cl  —  <To^ 


> 


0*1  —  cr0  /EfTT , 

a3  *  o-o  \/  qV*  ‘ > 

Example  III-3:  The  standard  errors  of  the  best 
values  for  x^ ,  *2  anc*  x3  Example  III-l. 

Standard  error  of  unit  weight  for  unweighted 
observation  is 


CT0  * 


MrM 


23035  .08856  -.0059?  .50793 


MrM^  .313 


2303S  1 
08356 
.0059? 
50793 


•» 


The  standard  errors  of  the  best  values  are  given  by 

Equation  III-17  as  = 

For  unweighted  observations,  q^’s  are  the  elements 
T  -1 

of  (A  A)  which  was  calculated  in  Example  III-l. 


•  0  21859 


-.OlMST1 


.  00?8?5 


Ol6l8?2.  .  00  T8>5 

•  08U233  .  0135423 


CT^  0-o\T^  =  -565  V. 022853  =  -085, 

<y^x  -  cr0\l9oa  as.  .  565  0632.33  =  -t(>3, 

cr*s  —  s  .545  ^.074483’  ss-154. 


T  - 1 

In  the  (A  A)  matrix,  off  diagonal  terms  are  used 
to  find  the  covariances  of  unknowns.  Covariance  ^ 
is  equal  to 

O'a  —  °~o  \Jt\  n  ' ' 

From  covariances,  the  correlation  coefficients  of  variables 
are  obtained.  Correlation  coefficient  given  as 


P 


12 


CT.i 

<T\C \  * 
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# 


The  interpretation  of  the  standard  errors  computed 
above  is  that  there  is  a  68%  probability  that  the  adjusted 
values  for  x^,  and  x3  are  within  ±.085,  ±.163  and  ±.154 
of  their  true  values,  respectively. 

Example  III-4:  The  standard  errors  of  Xj ,  x 2  and 
x3  in  Example  III- 2. 

The  standard  error  of  unit  weight  for  weighted 
observations  is 

o-o  =\/vT^v ' 

V  n-m 


r 

1  0  0  0 

.  513&  .098?  -.00*9  -3??? 

oioo 

'038? 

0  0  2  0 

-.0069 

0  0  0  3 

.'in? 

• 

- 

\/TWV  =  .  ^114-  , 
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The  standard  errors  of  best 


values  are  given  as 


For  weighted  observations,  's  are  the  elements  of  (ATWA) 
which  has  been  already  calculated  in  Example  III-2. 


(ATWA^  = 


•  0113839 
—  0081314 
.  0O  374 


-.00  81314- 
. 0S93>95 
.  0151854 


.  002T4 
.0151854 
.  040514 


-  cr  o  fqw  '  =  .  843  ^.0113839'  =.0899  , 

0Vt  =  ovfqiir  =  •  843  \f- 059S>9s'  -  .  2os< 
<r»3  =  CTo  \)CJ33'  —  .  841  04OSI4  '  =  .  169' 


B.  APPLICATION  OF  LEAST  SQUARES  TO  HYDROGRAPHIC 

POSITIONING  SYSTEMS 

If  redundant  data  are  available,  the  least  square  adjust¬ 
ment  method  may  be  used  to  compute  the  coordinates  of  hydro- 
graphic  survey  positions.  Observation  equations  may  be 
written  for  various  types  of  survey  methods.  By  expressing 
these  equations  in  matrix  notation  and  using  successive  approxi 
mations  of  the  unknowns,  the  best  values  for  the  coordinates 
of  survey  positions  may  be  determined.  The  predictable 
accuracy  of  these  best  values  may  also  be  found.  Thus, 
redundant  observations,  coupled  with  mathematical  data 
adjustment  techniques,  produce  a  viable  method  of  system 
calibration  for  hydrographic  survey  data.  This  method  of 
calibration  is  referred  to  as  auto  calubration. 

1.  Azimuth  Angle  Positions 

The  working  range  of  azimuthal  systems  is  limited  to 
line  of  sight  distances,  i.e.,  5-15  nautical  miles,  depending 
upon  the  height  of  the  observing  instrument. 

Because  of  this  range  limit,  the  Universal  Transverse 
Mercator  (UTM),  or  other  plane  coordinate  systems,  may  be  used. 
Let 

yl’  y2’  y3  *  Northings  of  the  shore  stations  1,  2  and  3, 
respectively, 

x^,  *2>  x3  "  Eastings  of  the  shore  stations  1,  2  and  3, 
respectively, 

P  *  The  position  of  the  survey  vessel. 
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Then,  the  azimuth  (from  north)  of  the  survey  vessel  from 
shore  stations  can  be  written  in  terms  of  coordinates  as 


Aip  »4arfl  .  Ajf  sstarT*  ,  Ajp  =  tan-1 

*p-*3 

In  these  equations,  and  y^  are  the  best  estimate  of  the 
survey  vessel  coordinates  which  are  to  be  determined. 

These  equations  are  non-linear.  Thus,  in  order  to 
form  observation  equations,  they  must  be  linearized. 

Letting  xp  *  x0  +  Ax  and  yp  *  yo  +  A>SwIiere  x0  and  Yq  are 
the  approximate  coordinates  of  the  vessel’s  position,  and 
using  Taylor  series  expansion  for  linearization, 

f  --f  (  4*  H-A*  +  2L  Aq-*- . . 

***•  ^9  J 


where  {  (%9^9)  =  A  Co  —  -tarT1  . 

*o“V*C 

The  partial  derivatives  are 


T>f  _  _  yc-vjc  2£-  — 

T>*o  sk  1 


The  observation  equations  now  may  be  written  in  the  follow¬ 
ing  detailed  form: 
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rWr*L«rtM» 


are  the  measured  azimuths,  and  q  •  57.2958,  the  conversion 
factor  from  radians  to  degrees. 

Having  obtained  the  observation  equation,  the  normal 
equation  may  be  formed  and  solved  by  following  the  procedures 
outlined  in  Section  II. A. 

Using  the  computed  values  of  Ax  and  Ay,  new  trial 
point  coordinates  may  be  formed  as  follows: 

y  =  +^9 . 

The  values  are  substituted  in  the  observation  equation  for 
the  initial  x^,  y_  coordinates.  The  least  square  solution 

o  o 

is  iterated  until  the  Ax  and  Ay  values  approach  zero. 

Example  III-5:  Referring  to  Figure  III-2,  the 
coordinates  of  the  shore  stations  are 

Luces  (#1)  Mussel  (#2)  MB 4  (#3) 

x  4,055,042.7  m  4,053,453.2  m  4,053,917.2  m 

y  595,794.5  m  597,967.8  m  603,425.2  m 

The  standard  errors  for  the  azimuth  observations  are  -  .02°, 
a 2  -  .024®  and  Oj  *  .018°.  The  following  angles  were 
measured: 

p  -  Luces  -  Mussel  *  ■  50?164 

p  -  Mussel  -  Luces  ■  *  99?360 

p  -  MB4  -  Mussel  ■  ■  47? 865 


88 


The  least  square  method  will  be  used  to  determine  the  best 
values  for  the  coordinates  of  the  survey  vessel. 


Given:  A12  ■  126?180  Given:  A21  *  306?180 

Measured:  *  5Q“164  Measured:  *  99?360 

Alp  "  76*016  A2p  *  45?540 

Given:  AJ2  -  265?140 
Measured:  *  47?865 

A__  -  313?005 

3P 

First,  assume  ■  4,055,000 

*  600,000 


The  observation  equation,  V  *  AX  -  L,  is  then 


r 

- 

*■ 

*  *■ 

V» 

_.  01362 

-.000138 

a* 

Va 

- .  0\18S 

.013581’ 

- 

Vs 

•  oisioe 

. 00  48CR- 

m 

L 

-14.566 

25  .461 
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Using  the  standard  errors  of  each  station,  a  weight  matrix 
is  formed: 


Let  k  *  0.024,  then 


Using  the  A,  L  and  W  matrices,  the  components  of  the 

T  T 

normal  equation,  A  WAX  -  A  WL  ■  0,  are  written 


* 

•  - 

- 

.  000997** 

000IO9T 

Ax 

14032 

00010  9f 

.00021  ST 

Ay 

.1131 

*  <* 

The  solution,  X-  (ATWA) 'X (ATWL) ,  is  then 


1059.2  5H.6 

1 , 10  32 

’1231.8' 

— 

514.  i  W>13A 

m 

.1232 
_  « 

1144.0 

Now,  the  new  trial  point  coordinates  are  found. 

% A*  —  4,055,000  -H231.8  *4,0S6,23U8, 
j  =  y0-tAy  =  600 ,000  -1-3144-0  =  601,144.0. 


Using  new  trial  point  coordinates,  solutions  are  repeated 
until  Ax  and  Ay  vanish.  Table  III-l  shows  the  data  for  other 
trial  Ax  and  Ay  values  and  the  new  trial  point  coordinates. 

The  best  estimate  of  the  coordinates  for  the  survey 
vessel  is 

x^  -  4,056,302.9 

P 

yp  *  600,867.4 

2.  Sextant  Angle  Positions 

In  sextant  angle  positions,  similar  to  the  resection 
problem  in  geodetic  work,  the  measured  quantities  are  the 
included  angles  at  the  sounding  vessel  between  the  shore 
stations  as  shown  in  Figure  III-3. 
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or  in  terms  of  the  coordinates. 


Un"1  -  -tan'*  =  <*\  , 

Kx-Xp  *i-Xp 

tan"  ^~ap  t~n"  *— »»  =  «<*, 

'ki- Xp  Xx— xp 

too"'  — —  ■tan-1  id3-^P_  =  cK  5 
Xi*—  Xp  ^1“Xp 

Letting  x  -  x^.  +  Ax  and  y^  -  y^  +  Ay  and  linearizing  with 

p  o  p  o 

Taylor  series  expansion, 

{(*,$)  =  f(^v)oi  +  "5£.  Ax  h-  li-ky  + 

'Dy>®  5 

where 


Hl  =. 

iix-iki 

a»- 

>20 

2  ^ 

>10 

*f.  _ 

Xv-  Xo 

Xi-** 

s«® 

**> 
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The  observation  equations  may  then  be  expressed  as 


* 

y»-a® 

Xt  —  >»0 

V, 

’ 

C1 
=>  2jO 

Ax 

si'z-  -y« 

*2— '  *0 

o*x— (  &©»>-  Acai 

<=^3  — (A* Ov  "A 04^ 

Soft 

Ay 

V) 

_ 

. 

y3-y« 

-’30 

X*-*ft 

- 

- 

where 

Q  *  57.2958  is  the  conversion  factor  from  radians  to 
degrees , 

A01’  A02’  A03*  A04  are  coinPute^  azimuths  of  lines 
01,  02,  03,  04  using  trial  point  coordinates  x^,  yQ. 

Once  establishing  the  observation  equations,  the 
solution  is  found  as 

X  *  (ATA)_1ATL  . 

The  process  is  repeated  until  Ax  and  Ay  become  very 

small. 

EjCample  III-6:  Referring  to  Figure  III-4,  the  * 
coordinates  of  the  shore  station  are 


Figure  III -4:  Determination  of  a  position  for  sextant  angle 
fixes  using  least  squares  adjustment. 
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X 


Luces  (#4) 
4,055,042.7 
595,794.5 


MB 4  (#1)  Use  (#2)  Mussel  (#3) 

4,053,917.2  4,051,216.9  4,053,453.2 

y  603,425.2  600,372.0  597,967.8 

Measured  angles  are 
MB4  -  p  -  Use  »  49?927 , 

Use-p  -  Mussel  *  38?130, 

Mussel  -  p  -  Luces  *  30.396. 

The  least  square  method  will  be  used  to  determine 
the  best  values  for  the  coordinates  of  the  survey  vessel. 

Let  the  first  assumed  position  be  xQ  *  4,057,000  and  y^  *  599,000. 
Using  the  first  approximate  position. 


tan 


-1 


* 


AQ1  =■  124*862 ,  A02  -  165?712 ,  Ap3  *  196?235  and  A04  =»  238?591 
are  obtained. 

The  observation  equation  is 


V, 

-.006366 

-  Oo3$3<f 

An 

9*.<ro 

Va 

— 

00  668? 

♦  00W*f 

- 

7,  bo> 

X3 

—00  8663 

-.00  69h'L 

_ 

-ir.ito 

T  T 

and  normal  equation,  A  AX  -  AL  ■  0,  is 


a  oooifcofc 

.0000015 

A* 

-.00301 

«  0000015 

.oooo  a  i> 

Ay 

.  151W 

The  solution,  X  ■  (ATA)”*  A^L,  is 


6129.4 

_  1116 

- .oo30i 

-m  .  6 

H^.6 

.  15114 

A133.1 

Then,  the  new  trial  point  coordinates  are 

x  »  x0  +  Ax  -  4,057,000  +  (-47)  *  4,056,953, 

y  -  y0  +  Ay  -  599,000  +  1793.1  -  600,793.1. 

Using  new  trial  point  coordinates,  the  above  steps  are 
repeated  until  Ax  and  Ay  values  become  vanishingly  small. 

For  every  trial  Ax  and  Ay  value,  new  trial  points  coordinates 
are  tabulated  in  Table  III -2. 

The  best  values  for  the  coordinates  of  the  sounding 
vessel  are 

x  -  4,056,512.3, 

Mr 

yp  *  600,864.5  . 
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Iteration  Change  in  Coordinates  Coordinates 
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3.  Range -Range  Positions 


In  range-range  positioning,  when  the  distances  are 
short  (i.e.,  line  of  sight  type  equipment,  less  than  20 
nautical  miles),  a  plane  coordinate  system  may  be  used.  Let 


xl»  x2 *  x3 


yl*  y2*  y3 


Eastings  of  the  shore  stations  #1,  2,  3 
Northings  of  the  shore  stations  #1,  2,  3 


Xp  *  Easting  of  'he  survey  vessel 


y^  ■  Northing  of  the  survey  vessel 


Then,  the  distance  between  the  ith  shore  station  and 
the  survey  vessel,  in  plane  coordinates,  is 


■ip  *  (£=1,2,3). 


This  function  is  non-linear  and  has  to  be  linearized. 
Introducing  approximate  coordinates  (x^,  y^)  for  Xp  and  yp, 
then 


XP  "  xo  =  AX » 


y0  *  yo  +  Ay  • 


Using  Taylor  series  for  linearization,  the  result  becomes 


Sip 


+11  A*  +  H- + 
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After  linearization,  the  observation  equation  is 


yo-y* 

V. 

S.o 

So 

A* 

Sip  -  Sjo 

% 

*©*“ 

ye-  3a 

^  ZO 

*9 

— 

Sap  -  Szo 

-  S:l5 

S3o 

&30 

or  in 

the 

matrix  form. 

V  -  AX  - 

L, 

where  ; 


S,^,  S_,  are  the  measured  distances, 

lp  2p  3p 

^10*  S20*  S30  are  the  comPute<*  distances  using  xQ  and  yc. 

In  ranging  systems,  when  the  distances  are  long, 
coordinate  computations  must  be  carried  out  on  the  appro¬ 
priate  ellipsoid  using  rigorous  geodetic  formulas.  Let 


=  Computed  geographical  coordinates,  latitude 
and  longitude,  of  the  survey  vessel, 

*  Latitude  and  longitude  of  the  ith  shore  station, 
*>  Azimuth  from  ith  shore  station  to  approximated 
position  O, 

■  Azimuth  from  O  to  ith  shore  station, 

■  Distance  between  O  and  ith  shore  station. 


Although  the  computed  observations  must  utilize  rigorous 
geodetic  solutions,  the  differential  equations  of  the  observa¬ 
tions  may  be  approximated  using  spherical  trigonometry  [Ref.  3] : 

ds0l  -  Sin  1”  C-fto  C0s  A©cA(t)0  -  Rccos  kiod^i" 

+  CosC|)[.  S  tn  A  La  l, 

where  d<t>  and  are  in  seconds  of  arc,  dS  in  meters.  Sin  1" 

is  the  conversion  factor  from  seconds  to  radians.  and  R. 

O  1 

are  the  radius  of  curvature  in  the  plane  of  meridian  at 
point  O  and  ith  shore  station,  respectively,  defined  as 
[Ref.  18] 

R  =  Q 

where  a  is  the  semi  major  axis  of  the  datum  ellipsoid, 

2 

and  e  is  the  eccentricity  of  the  datum  ellipsoid. 

and  are  the  radius  of  curvature  in  the  plane  of  prime 
vertical  at  point  O  and  at  ith  shore  station,  respectively, 
defined  as  [Ref.  18] 


09  is  the  latitude  of  point  O  and  is  the  latitude  of  the  ith  shore 


station. 


The  partial  derivatives  of  computed  observations 


with  respect  to  parameters  are 

=  _  Sini"RoCos  Act, 

~^SqC  -  Siol''  Hi  Cos0c$mAio. 

"bXo 

Then,  observation  equation  is 


V, 

*  S«il‘ 

_  Ro Cos  Aoi  ,  C.OS0J  SltvXto 

_  60  Cos  A on.  ,  Kx  Sln-Ai* 

Ad) 

Spi  -  So\ 

Sr2-  -  So?- 

V* 

—  Ro  Cos  Ao3  >  ^3  G>s<t>-j  Sto  hyo 

AX 

Spl  -Soi 

where  S^,  are  computed  distances  using  inverse 

distance  and  azimuth  formulas  (these  formulas  could  be  found 
in  any  geodesy  text)',  and  Sp^,  Sp2>  Sp3  are  measured  distances 
between  point  p  and  the  respective  shore  station. 

After  forming  the  observation  equation,  the  normal 
equation  is  found  and  solved  as  in  previous  examples.  This 
process  is  repeated  until  A$  and  AX  become  smaller  than  the 
resolution  of  the  positioning  system. 


Example  1 1 1 - 7 :  Referring  to  Figure  III-5,  the  coordi¬ 
nates  of  the  shore  stations  are 

Luces  (*1)  Mussel  (#2)  MB 4  (#3) 

x  4,055,042.7  4,053,453.2  4,053,917.2 

y  595,794.5  597,967 .8  603,425.2 

Using  the  least  squares  procedure,  best  values  of 
coordinates  of  the  vessel  may  be  found.  Let  the  first 
assumed  position  xQ  *  4,056,000  m  and  yQ  =  598,000  m. 

Measured  distances  are  p  -  LUCES  =  4350  m,  p  -  MUSSEL  =  4506  m, 
and  p  -  MB 4  *  5267  m.  For  the  first  approximate  position  of 
the  vessel,  the  observation  equation  is  written: 


V, 

,999 

,  oilfc 
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.333 
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-.S3  3 

-54H.3 
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Normal  equation,  A  AX  •  A  L  8  0,  is 


1.28T 

-04S 

A* 

183^  .8 

_  .  ow 

h . 

And  solution,  X  3  (A^A)  1  ATL,  is 


A  * 

-  m 

- 

-.019 

—  — 

18 .8 

2183 .1 

A) 

-.019 

.584 

Then,  new  trial  point  coordinates  are: 
x  *  x0  +  Ax  =  4,056,000  +  2183.2  3  4,058,183.2 
y  ■  y0  +  Ay  *  598,000  +  787.4  3  598,787.4 

Using  the  new  trial  point  coordinates,  the  above  steps  are 
repeated  until  Ax  and  Ay  values  become  smaller  than  the 
system  resolution.  For  every  trial,  the  change  in  coordi¬ 
nates  and  the  coordinates  of  new  trial  points  are  tabulated 
in  Table  III-3. 

The  best  values  for  the  coordinates  of  the  sounding 
vessel  are 

xp  3  4,057,501.2 
yp  3  599,567.7 

The  standard  errors  in  the  northing  and  easting  may 
also  be  calculated  : 

“  L  (  £or  A  and  L.  1  Lost  kVeratvco  ■JaLues  ore  used  ^ , 
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where  q^'s  are  the  elements  of  (A  A)  which  has  been 
calculated  as 


C7*  a.  CTo  =  S.Z3  m  , 

j  CTJJ  3=  cr0  vjc}^  a  ^  .04  i  -H  "*  =  3>.  52  m , 

i 

i 


Hyperbolic  positioning  systems  measure  the  difference 
in  distance  from  a  vessel  to  the  two  shore  stations.  In 
Figure  III-6,  station  number  2  is  the  master  station,  and 
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numbers  1,  3  and  4  are  slaves.  Point  p  is  the  vessel's 
position,  and  its  coordinates  are  designated  as  <J>p  and  Ap. 


Point  O  is  the  first  approximate  position,  with  and  A^ 
representing  its  coordinates. 

The  differential  equations  of  the  computed  distances 
to  each  station,  may  be  written  as  [Ref.  3]: 

ckol  *  Sin  1"  L-£o  Cos/Vu  Aflo-  RcCos  A 

+■  Nc  Cos  (f)  c  A  Co  (iAo-AMl 

where  i  represents  the  shore  station  number. 

A^q  represents  the  azimuth  from  the  ith  shore  station 
to  approximate  position  0. 

R  is  the  radius  of  curvature  in  the  plane  of 
meridian  at  point  O  (as  defined  in  Section  B.3.). 

is  the  radius  of  curvature  in  the  plane  prime 
vertical  at  the  ith  shore  station  (as  defined  in  Section  B.3.). 

The  partial  derivatives  of  the  function  with  respect 
to  4>  and  A  are 


_  Sin.  1"  C  os  AoC  . 

*00 


~asoL 

"bAo 


Sin.1  Cos  56 Siru  Alo  . 


The  range  difference  between  the  distance  from  the 
vessel  to  the  master  and  the  distance  from  the  vessel  to 
the  respective  slave  station  is  expressed  in  the  equations 
below. 


*fsi  _  =  Sfn.  l"  R«  ( C  os  AoC  -  Cos  Aoo.) 


~^s>qa  _  j Soi  — =.Sinl"  HCCcs (Pc  (Sict. /\ao  -  Sin  Ai©') 


Note  that  station  number  2  is  the  master  station,  and 
the  range  difference  is  stated  in  terms  of  the  partial 
derivatives . 

With  this  information,  the  observation  equation  is 
written  as: 


vt 

Po  (  Cos  A©i  —  Cos  Aox) ,  Costf,  l  Sin.  Azo— Sin  A»o) 

=  Siol“ 

£©  (  Co s  A® 3  -CoS  /W  (  Ka  Cos^j  (  Sin.  A20  -  *>irv  A  3®) 

^3 

Ro  CCos  &04  -Gcs  Ao^  ,  H3  (  $vl\  Aa©  -S 

(  Spa-  Spt)  —  (  Soz- 

(  Spx  -  Sp3V(  Soi-  So?) 

C  Spa  —  Sp<*)—  ( Soz-  Son) 
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where  ; 

^01’  ^92*’  *’  are  comPuted  azimuths  from  approximate 
position  0  to  shore  station  1,  2 . 

AlO*  A2DJ  are  comPuted  azimuths  from  shore  station 
number  1,  2,...  to  approximate  position  0. 

(Sp2  *  S^) ,  (Spj  -  Sp3) »  _  are  measured  range 

differences. 

(S02  *  s0i )»  (S02  '  S03)»  are  comPuted  range 

differences . 

Sin  1"  is  conversion  factor  from  second  to  radian. 

After  writing  the  observation  equation,  the  normal 
equation  is  solved  and  the  best  estimate  of  the  coordinate 
values  is  found  as  previously  discussed. 

The  process  is  iterated  until  A 4>  and  AX  become 
smaller  than  the  standard  error  of  the  specific  hyperbolic 
system  be'ing  used. 

5 .  Global  Positioning  System  (GPS) 

Global  Positioning  System  fixes  are  obtained 
utilizing  the  computed  distances  from  the  position  of  GSP 
satellites  to  a  GPS  receiver.  The  receiver  measures  the 
arrival  of  a  timing  pulse  from  every  satellite  within 
acquisition  range.  The  transmit  time  of  each  pulse  is 
encoded  in  the  received  signal.  Thus,  distance  is  computed 
using  the  one  way  travel  time  between  each  satellite  and  the 
receiver  multiplied  by  the  propagation  velocity  of  electro¬ 
magnetic  energy.  Three  such  satellite  to  receiver  ranges 


may  then  be  applied  to  solve  for  the  coordinates  of  the 
receiver. 

Using  three  satellites  to  determine  a  fix  results  in 
a  unique  solution  for  the  position  coordinates  (x,  y,  z) . 
However,  significant  error  may  be  induced  due  to  drift  in 
the  receiver  clock.  This  additional  unknown,  receiver  clock 
bias  (E) *  may  be  resolved  by  processing  four  satellite 
ranges. 

For  position  fixing  at  sea, it  is  likely  that  the 
z  coordinate  may  be  input  as  a  known  value  based  on  a  given 
antenna  height  above  sea  level.  Thus,  the  number  of  unknowns 
will  be  reduced  to  three.  By  using  four  or  more  satellites, 
redundant  observations  are  then  available  so  that  the  data 
can  be  adjusted  by  the  method  of  least  squares. 

Introducing  the  following  variables,  observation 
equations  may  be  written  in  a  straightforward  manner: 

R^,  R2,  Rj  ,...  *  Measured  distances  from  receiver 

to  satellites  S^,  S2,  S3, 

(Xj^,  y-p  z^) ,  (x2,  y2,  z 2 ) ,  ...  »  Known  positions  of 

satellites  S^,  S2,  S^,... 

x,  y,  z  *  Unknown  position  of  the  observer, p. 

E  *  Receiver  clock  bias  (unknown) . 

Then,  the  basic  equations  are 
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ftx  -=  E  +  +  Cy-yxf  +( k 

^  -  E  ■*  N/U-^jf  +  Cy-Vfc)  i"  ( 3:  3V1'  * 

I 

! 

! 

1 

»  _  _ 

Ra  *  E  +  \/(  ^-KnV'+Cy-^ nfVU-^nV’  . 


Here,  the  ranges  R^,  R2,  R^,  ...  ,  Rn  include  the  actual 
satellite  to  receiver  distance  plus  some  offset  due  to 
receiver  clock  error.  In  the  above  equations,  the 
satellite  positions  are  known,  and  the  four  unknowns  are  the 
user  position  (x,  y,  z)  and  user  clock  error. 

Since  the  observation  equations  are  non-linear,  the 
Taylor  series  must  be  applied  to  form  equations  suitable  for 
use  with  the  method  of  least  squares.  Let 
X  *  XQ  +  Ax  z  ■  zQ  *  Az 

y  *  y0  +  Ay  e  =  e0  +  ae  . 

Using  Taylor  series, 

Rtp  %  Eo  +  -»-(9e-yL)x  i'to-'il)1'  ♦ 

hu  US-  •+■  A& 

RCo  £Lo 

where  R.  is  the  distance  between  a  satellite  and  the  user 

iP 

position,  p. 
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R^d  is  the  distance  between  a  satellite  and  approxi¬ 
mated  user  position. 

Observation  equations  are  written  in  the  following 
detailed  matrix  form: 
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where 

Rip,  R2p  .  are  the  measured  distances, 

R10’  R20 .  are  comPute<*  ranges  from  the  formula 

R  Co  ■=.  E.  o  +  \/(  *<o  —  , 

From  this  matrix,  the  normal  equation  may  be  formed 


and  solved  as  previously  discussed.  The  process  is  repeated 
until  the  values  of  Ax,  Ay,  Az  and  AE  approach  zero. 


Example  1 1 1 - 8 :  At  0800  Zulu,  May  1,  1980,  a  satellite 
fix  was  taken  using  a  GPS  receiver  aboard  USNS  ACANIA  in 
Monterey  Bay.  The  measured  distances  between  the  satellites 
and  the  receiver  were 

Spl  "  20,640,380.8  m 
Spz  *  20,357,184.1  m 
S_,  *  23,287,346.8  m 

P-5 

-  21,699,908.4  m 
Sp5  "  25,416,133.6  ra 

The  satellite  coordinates  were 

S  #1  S  #2  S  #3 

xx  *  6,097,294.4  x2  -  1,819,274.3  x3  -  9,268,094.7 

y  -  -4,364,543.9  y2  ■  -2,240,846.4  y3  ■  13,290,138.0 

zx  •  22,658,876.2  z2  -  23,721,192.7  z3  *  13,622,934.4 

S  #4  S  #5 

x4  *  -8,198,461.9  x5  -  -21,419,309.7 

y4  -  -18,813,603.1  y$  -  12,865,351.8 

z4  *  19,040,626.8  z5  *  4,832,143.1 

Applying  the  method  of  least  squares  to  determine  the 
user  position,  first  assume: 
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xc  =  -2,640,000 
yQ  -  -4,235,000 
zQ  *  3,960,000 

E0  »  10,000  . 

For  the  first  iteration,  the  observation  equation 
is  written  as 
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and  the  normal  equation,  A  AX  -  A  L  *  0  , 


1.039 

.0783 

.  bO 43 

-  .1584 

A* 

3296.9 
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Av, 
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The  solution,  X  3  (ATA)_1  A^L,  is 


30  40-9 

“tb4fe-t 

-2T-OS.2 

-\0S4O.9 


New  trial  point  coordinates  are 

x&  3  -2,636,959.1  zq  3  3,957,294.8 

3  -4,236,646.6  E&  3  -840.9  . 

Using  new  trial  point  coordinates,  the  above  steps 
are  repeated  until  Ax,  Ay,  Az  and  AE  values  become  vanish¬ 
ingly  small.  For  other  trials  (iterations) t  the  Ax,  Ay,  Az 
and  AE  values  and  new  trial  points  coordinates  are  tabulated 
in  Table  III-4. 

The  final  user  coordinates  are 
x  3  -2,636,937.1 
y  3  -4,236,666.2 
z  3  3,957,250.8  . 

And  receiver  clock  bias  is  E  3  -869.8  m. 
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Change  in  Coordinates  Coordinates 


C.  USE  OF  THE  ERROR  ELLIPSE  IN  ANALYZING  THE  ACCURACY 

OF  HYDROGRAPHIC  POSITIONS 

In  the  least  square  adjustment  process,  the  positional 
errors  are  found  in  the  direction  of  the  x  and  y  and  X) 
coordinate  axes.  These  a  and  a  values  indicate  the 

*  y 

expected  displacement  of  the  fix  in  the  direction  of  the 
coordinate  axes,  but  they  do  not  necessarily  define  the  maxi¬ 
mum  and  minimum  errors  associated  with  the  axes  of  error 
ellipse  (Figure  1 1 1 - 7 ]  . 

Maximum  and  minimum  standard  errors  are  found  by  defining 
the  orientation  of  the  error  ellipse  in  terms  of  the  x,y 
coordinate  system.  Let  the  coordinate  system  defining  the 
semi-major  and  semi-minor  axes  of  the  error  ellipse  be  u 
and  v  as  indicated  in  Figure  III-8. 

The  following  relationship  exists  between  the  ellipse 
(u  and  v)  and  the  ground  (x  and  y)  coordinate  system. 

U  =  *  Sin  9  Cos  9 

(III-18) 

V  *  *  Cos©  -y  Sm  0 

In  these  transformation  equations,  the  angle  8  is  the 
rotational  angle  between  the  y  and  u  axes  (measured  clockwise 
from  y  axis  to  the  u  axis). 

The  lengths  of  the  semi -major  and  semi-minor  axes  are 
given  by  : 


2 


Figure  III-8:  Error  Ellipse. 


(III-19) 


In  above  equations,  oQ,  the  standard  error  of  unit  weight, 
is  known  from  the  least  square  adjustment  of  point  p,  quu  and 
({yy  are  given  by1  : 

lFor  detailed  derivation  of  these  equations  see  Ref.  16, 
pages  181-183. 


^  "*■  ^ 9yy ^  Cos2,&  +  q^y Svc\  19  (in-20) 

Sw  ,*7£,(cKx  •+  SuO  +”2  ^ 9** ~  Riia  ^  ^oi  *"  ^*3  Sm  19  ,  (in  -  21) 

T  - 1 

where  q  ,  q  and  q  are  the  elements  of  the  (A  A) 
xx  yy  xy 

T  - 1 

(for  unweighted  observations)  or  (A  WA)  (for  weighted 
observations ) ,  i . e . , 


(ATM"'  or  IAT\NM“ 


S*a  ’ 

Syy 

Equation  II I- 20  reaches  its  extreme  value,  and  quu  is 
maximum,  when 


ton  le  =  __!ai2_  (III-22) 

Inserting  Equation  III -22  into  I II -20  and  I II -21,  and 
defining  D  as . 

D  =C(c)„_9,w')'1+  4CWH?1  (IH-23) 
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quu  and  qvv  may  be  written  as 

+  q<»  -+D>  (in-24) 

—  -J-  {*-!>.»  +  955  CHI-25) 

and  from  Equation  III-19,  the  semi-major  and  semi-minor  axes  are 
Q?  =  i.o-.'(q„+qa;)  +lO  (HI-26) 

+q^_oy  (III-27) 


Using  these  expressions,  the  error  ellipse  can  be  con¬ 
structed  at  any  point  whose  coordinates  were  determined  by 

T  -l  T  -1 

least  square  adjustment  if  the  (A  A)  or  (A  WA)  matrixes 
are  known. 

Example  III -9:  In  order  to  determine  the  error  ellipse 

parameters  for  the  range-range  example  problem  (example  I II -7), 
T  -1 

recall  that  (A  A)  was  determined  as 


-.14 

."H 
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4.04. 


and  the  standard  error  of  unit  weight  was  oQ  * 

The  semi-major  and  semi-minor  axes  of  the  error  ellipse, 
according  to  Equations  1 1 1 - 2 6  and  III-27,  are  found  by  first 
solving  Equation  1 1 1  -  23  *. 

—  C  (.44  -.T6)  +  4  (-.14^  I  ■=.  .  305. 

Then, 

Q  =  •J  °«  (  *1  ■*.».  +93*  +  D  } 

Qa  -Z.-L  (4.0*0*  (.6H +.76+.  30S)  =13.9 
Q  -=■  3.  m 

ba  =i_ai?-(q„  +  qss-b^ 

t»a  =  _L  (q.o**y(.6‘t  +  .76-.305)  -9.9% 
b  =  2.99  m. 

The  semi-major  axis  is  3.73  m,  and  semi-minor  axis  is  2.99  m. 
According  to  Equation  I II -22,  the  angle  6  is  found: 
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ton 

20  -  113?2 

0  *  56?6  which  defines  the  orientation  of  the  error 
ellipse. 

1 .  Some  Characteristics  of  the  Error  Ellipse 

A  number  of  important  properties  of  the  error  ellipse 

can  be  obtained  by  analyzing  the  equations  given  in  the  previous 

section.  The  existence  of  the  error  ellipse  points  out  an 

important  fact  that  the  accuracy  of  the  location  of  a  point 

in  question  is  not  the  same  in  every  direction.  An  analysis 

of  equations  III-26  and  III-27  demonstrates  that  the  formulas 

for  the  semi -major  and  semi -minor  axes  are  composed  of  two 

parts:  the  standard  error  of  unit  weight,  which  defines  the 

T  - 1 

scale  of  the  error  ellipse,  and  the  elements  of  the  (A  A)  or 
T  -l 

(A  WA)  matrix,  which  define  its  shape. 

To  reduce  the  error  ellipse  into  a  circle,  where  the 
accuracy  of  position  is  equal  in  every  direction,  the  follow¬ 
ing  condition  must  be  met: 

a/b  »  1  . 

According  to  Equations  1 1 1 - 26  and  1 1 1 - 2 7  this  is  possible 
only  if  D  *  0  : 

n=L(s„-%f+4(af'0. 


1 1— iV> 
(•hH-  .li) 
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which  means  ti. 


a  ■  q  and  q  =  0 . 

Hxx  Myy  Hxy  * 

and,  according  to  Equation  III -17, 

a  “a 
x  y  • 

Another  important  characteristic  is  that  the  stun  of 
the  squares  of  the  standard  errors  in  x  and  y  directions  is 
invariant  to  the  rotation  of  the  coordinate  system,  or 

+  *>  =  era  +  crv  -St  C?%  +  .  (111-28) 


Equation  III -28  leads  to  the  concept  of  root  mean 
square  error,  drms,  as  follows  : 


drms  =  hi  +  a?  =hl  +  c?=hx* ’o'  tm-29) 


or,  from  Equations  III -26  and  I II -27. 


IV.  CONCLUSION 


Conventional  survey  systems  will  provide  the  primary  means 
of  hydrographic  positioning  for  several  years  to  come. 

Thus,  the  concepts  of  drms  and  the  graphical  approach  to 
developing  error  contours  are  very  useful  tools  in  survey 
planning  and  execution. 

Survey  planners  must  exercise  care  in  establishing  the 
position  of  navigation  aids.  The  resultant  net  geometry 
determines  the  accuracy,  and  thus  the  d  „  error,  of  the  fix 
positions.  Accuracy  requirements  for  the  collection  of 
hydrographic  survey  data  greatly  limit  the  size  of  the 
effective  survey  area.  Through  careful  planning,  the 
number  of  navigation  aid  shore  stations  can  be  minimized 
while  still  meeting  position  accuracy  requirements  for  the 
survey. 

Currently,  more  research  is  needed  to  determine  the 
environmental  factors  which  govern  variations  in  the  propa¬ 
gation  velocity  of  electromagnetic  energy.  If  this  important 
parameter  could  be  more  accurately  modeled  throughout  the 
survey  area,  the  effects  of  systematic  errors  due  to  these 
velocity  variations  could  be  greatly  minimized. 

As  shown  in  this  paper,  methods  exist  today  by  which  the 
accuracy  of  survey  positions  can  be  greatly  improved  through 
the  use  of  redundant  observations  and  data  adjustment  technique 


The  method  of  least  squares  adjustment  provides  a  best  esti¬ 
mate  of  position,  plus  the  size  and  orientation  of  the  error 
ellipse  associated  with  that  position,  for  every  point  deter¬ 
mined  by  the  survey  system.  In  addition,  the  error  ellipse 
quantifies  the  predictable  accuracy  (as  shown  in  Figure  1 1 - 7) 
of  each  position  as  compared  to  the  repeatable  accuracy 
available  from  conventional  survey  methods. 

The  application  of  these  techniques  will  become  more 
widespread  when  the  Global  Positioning  System,  is  fully 
operational.  Observations  of  position  from  any  number  of 
navigation  and  positioning  systems  (GPS,  LORAN,  hydro  position¬ 
ing  systems,  etc.)  can  be  combined  in  a  least  square  solution. 
Observation  equations  may  be  written  and  weights  can  be 
assigned  as  a  function  of  accuracy  for  each  system. 

In  preparation  for  these  future  improvements,  hydrographers 
must  work  to  understand  and  implement  the  concepts  discussed 
in  this  paper.  Data  must  be  processed  by  computer.  There¬ 
fore,  programs  need  to  be  written  which  can  perform  the 
iterative  least  squares  adjustment  on  the  appropriate  obser¬ 
vation  equations.  Errors  must  be  analyzed  to  assess  the 
improvement  in  accuracy  resulting  from  redundant  observations. 
Additionally,  standard  hydrographic  survey  procedures  need 
to  be  reviewed  to  determine  if  more  efficient  methods  may 
be  adopted  when  redundant  observations  and  data  adjustment 
techniques  are  used.  For  example,  the  method  of  least 
squares  may  be  programmed  into  onboard  computers  so  that 


data  may  be  adjusted  and  evaluated  in  real  time.  Alternately, 
redundant  data  may  be  collected  and  recorded  for  later  pro¬ 
cessing  ashore. 

The  technology  is  available  today  to  employ  data  adjust¬ 
ment  methods  in  hydrography.  This  technology  must  be 
analyzed  and  adapted  to  match  the  systems  and  requirements 
unique  to  hydrographic  survey. 


ANALYSIS  OF  RANDOM  ERRORS 
APPENDIX  A 

(The  information  given  in  this  section  was  taken  directly 
from  References  1  and  20.) 

ONE  DIMENSIONAL  ERRORS 

An  error  in  a  measurement  is  the  difference  between  the 
"true"  value  of  a  quantity  and  the  measured  or  derived  value. 
The  "true"  value  can  never  really  be  determined  because  of 
instrument  limitations  and  human  fallibility.  In  determining 
the  value  of  a  quantity,  only  one  measurement  may  be  necessary 
when  an  approximate  value  is  sufficient.  If,  on  the  other 
hand,  the  quantity  is  important  enough  to  require  a  more 
precise  value,  repeated  measurements  are  made.  Variations 
will  exist  between  the  values  obtained  from  several  measure¬ 
ments.  Applying  the  theory  of  the  normal  distribution  to 
these  measurements,  the  "best"  value  for  the  quantity  is  the 
mean  or  average  of  all  the  observed  values.  The  differences 
between  the  mean  and  the  observed  values  are  the  apparent 
errors  or  residuals  which  are  used  to  derive  a  statement  of 
precision  for  the  measuring  process.  When  the  residuals  are 
randomly  distributed  about  the  mean,  the  precision  of  the 
measurement  is  expressed  by  a  single  term,  the  standard 
error,  which  is  commonly  designated  by  the  Greek  letter  "sigma" 
(o) .  For  a  one  dimensional  normal  distribution,  this  value 
is  computed  by  squaring  all  the  residual  errors  (v) ,  adding 
the  squared  values,  dividing  by  the  number  of  errors  less 
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one  (if  n  independent  direct  measurements  are  taken  of  the 
same  quantity,  then  the  first  measurement  establishes  a 
value  for  the  unknown  and  all  additional  measurements, 

(n-1)  in  number,  are  redundant),  and  taking  the  square  root: 


Cr- 


% 


where  is  the  residual  defined  by  the  equation  “  Xi  "  x» 

:  observed  value 
x  :  mean  value 

n  :  the  number  of  observations  . 

The  normal  distribution  itself  is  represented  by  the 
function: 

p  Lv)  —  e  2-0'3'. 

The  normal  distribution  curve  and  the  meaning  of  the  standard 
errors  are  illustrated  in  Figure  A-l.  The  central  vertical 
axis,  p(v),  represents  the  probability  of  zero  error  with 
positive  errors  plotted  to  the  right  and  negative  errors 
to  the  left.  The  height  of  the  curve  above  a  particular 
point  on  the  horizontal  axis  is  proportional  to  the  probability 
of  an  error  of  that  amount. 


It  can  be  observed  from  the  normal  distribution  curve 
that  the  total  area  under  the  curve  is  equal  to  unity.  Also, 
the  area  under  the  curve  between  any  two  values  of  v^ 
and  v is  equal  to  the  probability  of  an  error  occurring 
between  these  limits.  So,  to  find  the  probability  of  an 
error  between  and  v2,  p(v)  has  to  be  integrated  between 
and  Y2.  The  area  under  the  curve  between  the  limits  of 
^  «  -a  and  v2'*  +0  68.271  of  the  total  area  under  the 

curve.  This  means  that  there  is  68.27%  probability  that 
errors  in  any  further  measurements  made  under  the  same 


134 


conditions  will  not  exceed  the  standard  error,  a,  with  a 
68.27%  probability.  The  standard  error  does  not  indicate 
the  probability  that  an  error  of  a  certain  size  will  occur;  it 
only  indicates  that  68.27%  of  the  errors  will  fall  within 
the  specified  limits  of  plus  or  minus  one  sigma. 

If  other  probability  levels  are  desired,  the  appropriate 
conversion  factor  may  be  found  in  Table  Al.  For  example, 
for  95%  probability,  a  should  be  multiplied  by  a  linear 
error  conversion  factor  of  2. 

Linear  error 

Probability,  %  conversion  factor 


50 

.6745 

68.27 

1.000 

90 

1.6449 

95 

2.000 

99.7 

3.000 

Table  Al :  Linear  error  conversion  factors  for  several 
probability  levels. 

TWO-DIMENSIONAL  ERRORS 

A  two-dimensional  error  is  the  error  in  a  quantity  defined 
by  two  random  variables.  For  example,  consider  the  position 
of  a  point  referred  to  x  and  y  axes.  Each  observation  of  the 
x  and  y  coordinates  may  contain  the  errors  v  and  v  . 


If  the  errors  are  random  and  independent,  each  error  has 
a  probability  density  distribution  of 


_± -  e  2-o-y 

"The  probability  of  two  events  occurring  simultaneously 
is  equal  to  the  product  of  their  individual  probabilities" 
[Ref.  1].  Applying  this  rule,  the  two-dimensional  probability 
density  function  becomes: 

p(v„y,>  _  e  2 V ** 

*2.T\  lT  vj 

rearranging  terras, 

p  lTT<r*<rv  =  e  a  «,  J 


taking  the  logarithm, 

JfivCp  ITT  a^~\—  .  Vy-  ->■  -V*  ■ 

J  <5?  * 

For  given  values  of  p(v  ,  v  )  [physical  meaning  of 

a  / 

p(vx,  Vy)  is  that  the  probability  that  two  random  variables 
v  and  v  take  values  in  the  interval  ±v  and  ±v  ] ,  the  left 
side  of  equation  is  a  constant,  k2>  then 

136 


P(nOss_J: —  e  2ef ’*  cmd  p(Wy) 


f 


Figure  A2:  Equal  probability  density  ellipses, 


In  general,  when  the  two  errors  are  correlated,  i.e., 

a  change  in  the  one  error  has  some  effect  upon  the  other,  the 

probability  density  function,  p(v  ,  vv) ,  becomes 

x  x 
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p (v*,v, )  * 


l _  (v^  ' 


<J*  cr. 


*»  Vcr-<-cr4 ' 


Then,  the  equation  of  constant  probability  density  ellipses 
(Figure  A3)  is 


k1 _ i _ 

o-ea) 


V»  _  o  f  V»Va 
CT*  OV 


where  p  *  correlation  coefficient  of  vx  and  vy  and  is  given  by 


p  =• 

^  0*0* 

The  probability  density  function  integrated  over  a  certain 
region  becomes  the  probability  distribution  function  which 
yields  the  probability  that  v^  and  v^  will  occur  simultaneously 
within  that  region,  or: 


P  -ff  p(v», dvudva 
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APPENDIX  B 

USEFUL  GRAPHS  FOR  THE  DETERMINATION  OF  REPEATABILITY  CONTOURS 


Intersection  angle,  B,  in  degrees. 

•Figure  Al:  For  ranging  systems,  the  graph  of  the  d  s/.as„ 

and  e/b. 
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Values  of  e/b 


Values  of  angle  B  in  degrees 


Figure  A2:  For  azimuthal  systems,  the  graph  of  d 
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